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executive  smwurr 


The  arsed  services  need  the  Arsed  Servleae  Vocational  Aptitude 
lottery  forss  6  aad  7  (ASVAB  6/7)  ae  as  ealletseat  screening  and  recruit 
claeelf lcatioa  teat  fros  i  January  1976  through  90  September  1980.  On 
1  October  1980  ASVAB  6/7  sea  replaced  by  ASVAB  forss  8,  9,  and  10  (ASVAB 
8/9/10).  The  purpoae  of  this  report  la  to  aeseas  the  validity  of  ASVAB 
6/7  and  to  sake  reasonable  Inferences  about  the  validity  of  ASVAB 
8/9/10.  By  "validity"  we  seen  the  correlation  between  test  scores  aad 
perforsancs  in  military  training  courses. 

He  sake  recommendations  about  the  best  ASVAB  8/9/10  composites 
(groups  of  tests  In  the  battery)  to  use  for  selecting  recruits  for 
various  training  progress.  Ha  also  suggest  minimum  acceptable  aptitude 
composite  scores  for  each  course  analysed  and  melee  recommendations  for 
future  improvements  in  the  formulation  of  composites. 

It  has  been  determined  that  the  officially  reported  ASVAB  6/7 
scores  were  Inflated  due  to  a  mlscallbratlon  of  the  test.  ASVAB  6/7 
scores  used  in  this  report  have  been  revised  to  reflect  the  correct 
calibration  of  the  test.  This  revision  ensures  that  an  ASVAB  6/7  score 
(in  this  report)  represents  the  same  ability  level  as  that  same  score 
will  on  the  new  ASVAB  8/9/10.  Vor  this  reason,  and  because  ASVAB  6/7 
and  ASVAB  8/9/10  measure  very  similar  aptitudes,  the  findings  of  this 
analysis  with  respect  to  ASVAB  6/7  can  be  generalized  to  ASVAB  8/9/10. 

Our  findings  are  based  primarily  on  an  analysis  of  the  training 
school  performance  of  26,039  Marine  Corps  recruits  who  were  tested  on 
ASVAB  6/7  and  began  training  in  Cl  1977  and  CY  1978.  This  data  was 
supplemented  by  FT  1980  failure  rates  for  86  training  courses.  The 
validity  analysis  and  aptitude  composite  selection  were  based  on  school 
performance  as  measured  by  the  final  grade  achieved  in  the  course.  He 
used  pass/fail  information  to  estimate  minimum  acceptable  aptitude 
composite  scores  (prerequisites).  Course  prerequisite  levels  have 
traditionally  been  stable  over  long  periods  of  time.  However,  since 
1976  two  downward  revisions  were  Inadvertently  made.*  The  downward 
revisions  were  followed  by  piecemeal  upward  corrections.  In  view  of 
this  instability  we  have  taken  as  our  point  of  departure  the  traditional 
(pre-1976)  prerequisite  levels  and  made  such  changes  in  these  as 
dictated  by  the  available  information. 


*  These  revisions  were  caused  by  the  mlscallbratlon  of  ASVAB  6/7  and  by 
af forts  to  compensate  for  the  undsrpredlction,  by  ASVAB  6/7,  of  tha 
performance  of  high  school  graduates. 


FINDINGS 

The  findings  of  the  enelyele  my  be  summarized  as  follows: 

e  ASVAB  6/7  wee  a  valid  test  battery  for  the  aelectloa  and 
classification  of  recruits. 

e  ASVAB  6/7  composites  were  somewhat  deficient  in  their 
ability  to  clearly  distinguish  aptitudes  important  in 
various  training  program  (differentiation) . 

e  The  use  of  multiple  conposltes  as  prerequisites  for 

courses  does  not  significantly  iaprove  the  prediction  of 
success  in  training.  This  practice  does,  however,  greatly 
restrict  the  supply  of  qualified  recruits  and  is  in 
general,  counterproductive. 

e  The  validity  of  ASVAB  6/7  conposltes  used  by  the  Marine 
Corps  compares  favorably  with  that  for  conposltes  used  by 
other  services. 

e  High  school  graduates  outperfora  non-high  school  graduates 
with  equivalent  aptitude  scores.  The  differential  is 
approximately  equivalent  to  10  composite  score  points. 

e  ASVAB  6/7  is  not  biased  against,  i.e.,  does  not  under¬ 
predict  performance  of  minority  recruits. 

e  The  Armed  Forces  Qualification  Test  (AFQT)  part  of  ASVAB 
Is  a  useful  measure  of  general  trainabillty  and  contains 
approximately  80  percent  of  the  predictive  power  of  the 
entire  ASVAB. 

e  The  AFQT  could  be  improved  as  a  measure  of  general  train- 
ability  by  adding  the  mechanical  comprehension  test  to  its 
formulation. 

e  The  General  Classification  Test  (GCT)  composite  used  by 
the  Marine  Corps  in  ASVAB  6/7,  and  not  available  in  ASVAB 
8/9/10,  my  be  replaced  by  the  General  Technical  (GT) 
composite. 

e  Selecting  aptitude  composites  empirically  for  each  course 
by  selecting  the  composite  that  correlates  best  with  the 
criterion  variable  is  unsatisfactory  and  leads  to  frequent 
and  capricious  changes  in  selector  composites. 

e  A  "global"  approach  to  composite  selection  is  preferred 
whereby  all  courses  are  grouped  by  a  priori  judgment  into 
mechanical  (MM),  electrical  (EL),  clerical  (CL),  field 


-iv- 


artillery  (FA),  combat  (00),  end  general  technical  (OF) 
areas  and  one  satisfactory  composite  la  empirically 
determined  for  each  area* 

e  Changes  In  the  battery  from  ASVAB  6/7  to  ASVAB  8/9/10 
should  not  result  In  any  loss  of  predictive  validity  If 
reasonable  choices  of  coaposltes  are  aade. 

e  The  Interim  ASVAB  8/9/10  composites  currently  used  by  the 
Marine  Corps  are  satisfactory  for  temporary  use*  The 
validity  of  the  clerical  composite  appears  to  be 
marginally  satisfactory  but  can  be  improved  by  adding  the 
mathematical  knowledge  (Mt)  test  to  Its  formulation. 

e  The  experimental  set  of  ASVAB  8/9/10  composites  we  de¬ 
veloped  appears  to  offer  Improved  differentiation  and 
improved  validity* 

RECOMMENDATIONS 

e  The  Marine  Corps  should  continue  to  use  the  interim  ASVAB 
8/9/10  composites  adopted  In  October  1980.  However,  as 
soon  as  practical,  the  CL  composite  should  be  changed  by 
adding  IK  to  Its  formulation*  Validation  of  these  compos¬ 
ites  should  be  conducted  expeditiously. 

e  Interim  ASVAB  8/9/10  composites  and  minimum  composite 
scores  suggested  for  use  in  all  entry  level  courses  are 
given  in  table  I. 

e  The  prerequisites  shown  in  table  I  apply  only  to  high 
school  diploma  graduates.  Prerequisites  for  non-high 
school  graduates  should  be  set  10  points  higher  than  those 
shown  in  table  I. 

e  An  experimental  set  of  ASVAB  8/9/10  composites  believed  to 
be  superior  to  the  interim  ASVAB  8/9/10  composites  has 
been  developed.  It  is  recommended  that  they  be  explicitly 
evaluated  in  the  validation  of  ASVAB  8/9/10.  This  set  of 
composites  is  given  in  table  II.  It  should  provide  better 
balance,  differentiation,  and  validity  than  the  interim 
set  of  composites. 

e  The  AFQT  score  should  be  redefined  by  adding  the  mechan¬ 
ical  coaiprehenslon  test  to  its  current  formulation. 

e  The  use  of  nultlple  test  prerequisites  (either  sore  than 
one  composite  or  one  composite  plus  an  individual  ASVAB 
test)  in  the  Recruit  Distribution  Model  (RDM)  should  be 
discontinued. 
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CHAPTER  1 


INTRODUCTION 


BACKGROUND 

The  Armed  Services  Vocational  Aptitude  Battery  (ASVAB)  is  the  test 
currently  used  by  the  armed  services  to  measure  the  mental  aptitudes  of 
prospective  recruits.  Scores  on  the  ASVAB  are  used  to  determine  eligi¬ 
bility  for  enlistment  and  to  classify  individuals  with  respect  to  the 
type  of  military  jobs  that  best  match  their  aptitudes.  This  report  is 
concerned  with  the  classification  aspect  of  ASVAB. 

The  subject  of  this  report  is  the  validation  of  ASVAB  forms  6  and  7 
(ASVAB  6/7)  for  Marine  Corps  recruits.  The  term  validation  is  used  here 
to  mean  the  establishment  of  a  relationship  between  test  scores  on  ASVAB 
6/7  and  subsequent  performance  in  military  training  courses.  The 
strength  of  the  relationship  will  be  measured  by  the  size  of  the  corre¬ 
lation  coefficient  between  recruits'  scores  on  ASVAB  and  their  perform¬ 
ance  in  training  courses  (validity).  If  such  a  relationship  is  found  to 
exist,  and  if  the  relationship  is  a  strong  one,  then  the  ASVAB  may  be 
viewed  as  a  valid  Instrument  for  the  selection  and  classification  of 
recruits. 

The  study  request  and  data  collection  plan  for  this  analysis  are 
given  in  appendix  A.  Initially  the  study  was  envisioned  as  beginning  in 
1977.  Analysis  was  to  follow  2  years  of  data  collection  and  a  report 
was  to  have  been  Issued  in  late  1979.  However,  in  early  1978  the  study 
sponsor  requested  a  revised  study  plan  that  called  for  reports  based  on 
analysis  of  the  partially  completed  data  set  by  September  1978.  These 
reports  [1,  2,  and  3]  were  made  available  as  requested.  The  full  data 
collection  was  completed  in  1979.  This  report  represents  an  analysis  of 
the  full  data  set  and  draws  on  the  earlier  results  [1,  2,  and  3]  as 
appropriate. 

Accepted  testing  policy  calls  for  the  occasional  replacement  of 
enlistment  tests  with  new  forms  of  equal  difficulty.  The  new  forms 
usually  cover  similar  content  areas  and  differ  from  the  previous  forms 
only  In  an  evolutionary  sense.  With  a  replacement  policy  of  this  kind, 
validity  Information  from  previous  forms  of  the  ASVAB  serves  as  a  useful 
estimate  of  the  validity  of  replacement  forms  until  data  collection  and 
analysis  for  the  replacement  forms  are  completed.  ASVAB  6/7  was 
replaced  by  ASVAB  8/9/10  on  1  October  1980.  We  expect  results  on  the 
validity  of  ASVAB  6/7  can  be  generalized  for  ASVAB  8/9/10  until  the  new 
forms  can  be  directly  validated. 

In  July  1980  the  Assistant  Secretary  of  Defense  (Manpower,  Reserve 
Affairs  and  Logistics)  reported  [4]  that  ASVAB  6/7,  in  use  from  January 
1976  through  September  1980,  was  mlscalibrated  and  that  this 
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miscalibration  inflated  the  test  scores  of  some  enlistees  during  this 
period.  A  revised  calibration  of  ASVAB  6/7  was  made  available  [5].  The 
parts  of  this  analysis  that  deal  with  absolute  values  of  ASVAB  scores 
(such  as  minimum  prerequisites)  were  revised  to  reflect  the  corrected 
calibration  of  ASVAB  6/7.  The  corrected  calibration  ensures  that  a 
given  score  on  ASVAB  6/7  represents  the  same  ability  level  as  that  same 
score  will  on  the  new  ASVAB  8/9/10.  As  a  result  of  this  revision  the 
findings  of  this  analysis  with  respect  to  minimum  prerequisites  on  ASVAB 
6/7  should  be  directly  applicable  to  ASVAB  8/9/10. 

STRUCTURE  OF  ASVAB  6/7 

ASVAB  6/7  consists  of  16  individual  tests  (see  table  1)  designed  to 
measure  aptitudes  and  Interest  in  a  variety  of  content  areas.  For  use 
in  classification,  groups  of  the  tests  are  combined  into  aptitude 
composites  shown  in  table  2.  The  composites  in  table  2  are  constructed 
from  the  tests  in  table  1  by  using  the  formulas  in  table  3.  See  [6]  for 
details  on  the  construction  of  the  composites.  If  the  ASVAB  is  a  valid 
predictor  of  success  then  recruits  who,  for  example,  make  high  scores  on 
the  Electronics  composite  will  be  expected  to  do  well  in  electronics 
training.  The  composites  used  by  other  services  will  also  be  examined 
in  this  report  and  are  described  in  appendix  B. 


TABLE  1 

INDIVIDUAL  ASVAB  6/7  TESTS 

GI  »  General  Information 
NO  »  Numerical  Operations 
AD  ■  Attention  to  Detail 
WK  -  Word  Knowledge 
AR  «  Arithmetic  Reasoning 
SP  ■  Spacial  Perception 
MK  =»  Mathematics  Knowledge 
El  ■  Electronics  Information 
MC  -  Mechanical  Comprehension 
GS  ■  General  Science 
SI  -  Shop  Information 
AI  -  Automotive  Information 
CC  ■  Combat  Scale 
CA  ■  Attentiveness  Scale 
CE  -  Electronics  Scale 
CM  -  Maintenance  Scale 


TABLE  2 


MAR It®  CORPS  ASVAB  6/7  COMPOSITES 


CO 

m 

Combat 

FA 

M 

Field  Artillery 

OF 

m 

Operators  and  Food  Handlers 

MM 

m 

Mechanical  Maintenance 

GM 

m 

General  Maintenance 

CL 

m 

Clerical 

GT 

m 

General  Technical 

EL 

m 

Electronics 

SC 

m 

Surveillance  and  Communications 

ST 

m 

Skilled  Technical 

GCTa 

m 

General  Classification  Test 

aWhen  expressed  in  percentile  form  this  composite  is 
known  as  the  Armed  Forces  Qualification  Test  (AFQT). 


TABLE  3 

FORMULAS  FOR  COMPUTING  MARINE  CORPS 
ASVAB  6/7  COMPOSITES 


CO 

m 

AR 

♦ 

SI 

+ 

SP 

+ 

AD 

+ 

CC 

FA 

m 

AR 

+ 

GI 

+ 

MC 

+ 

El 

+ 

CA 

MM 

m 

MC 

+ 

SI 

+ 

El 

+ 

AI 

+ 

CM 

GM 

m 

AR 

+ 

GS 

+ 

MC 

+ 

AI 

CL 

m 

AR 

+ 

WK 

+ 

AD 

+ 

CA 

GT 

m 

AR 

+ 

WK 

EL 

m 

AR 

+ 

GS 

+ 

MK 

+ 

El 

SC 

me 

AR 

WK 

+ 

MC 

+ 

SP 

ST 

m 

AR 

+ 

MK 

+ 

GS 

OF 

m 

GI 

+ 

AI 

+ 

CA 

GCTa 

m 

AR 

+ 

WK 

+ 

SP 

a 

When  expressed  in  percentile  form  this  composite  is 
known  as  the  Armed  Forces  Qualification  Test  (AFQT). 


OBJECTIVES 

The  objectives  of  this'  analysis  as  set  forth  in  the  study  request 
(appendix  A)  are: 

a.  To  determine  the  best  existing  aptitude  composite  for 
predicting  service  school  completion.  This  evalution 


includes  composites  currently  used  by  other  services  as 
well  as  those  used  by  the  Marine  Corps 

b.  To  determine  the  best  combination  of  subtests  for  pre¬ 
dicting  service  school  completion 

c.  To  determine  the  relationship  of  civilian  educational 
level  and  aptitude  composites  on  service  school  completion 

d.  To  determine  service  school  prerequisites  that  will  ensure 
high  rates  of  service  school  completion  without  unduly 
restricting  the  supply  of  qualified  persons. 


METHOLODOGY 


The  primary  methodology  used  to  address  objective  (a)  is  an 
analysis  of  correlations  between  measures  of  performance  in  service 
schools  and  ASVAB  6/7  composites.  The  correlation  analysis  will  be 
supplemented  by  regression  analysis,  factor  analysis,  and  graphical 
analysis  in  addressing  objectives  (b),  (c),  and  (d). 


The  primary  data  sample  used  in  this  report  consists  of  aptitude 
test  scores  and  school  performance  data  on  26,039  Marine  Corps  recruits 
entering  training  during  1977  and  1978. 

All  aptitude  test  scores  are  from  ASVAB  6/7  tests  that  were  admin¬ 
istered  within  the  first  few  days  after  arrival  at  recruit  depots. 

These  scores  were  available  for  all  recruits  in  the  1977-1978  data 
set.  ASVAB  scores  from  recruit  depot  testing  were  used,  rather  than 
those  from  cests  taken  at  the  Armed  Forces  Examining  and  Entrance 
Stations  (AFEES),  to  minimize  test  compromise  effects. 

Data  was  collected  for  46  courses.  Table  4  lists  the  complete 
course  titles  and  sample  sizes. 

Initially  we  considered  final  course  grade  (FCG),  time  to  complete 
the  course  (TIME),  and  pass/fail  (P/F)  as  measures  of  school  perform¬ 
ance.  Closer  inspection  revealed  that  only  the  FCG  criterion 


TABLE  4 


COURSES  EXAMINED  IN  THIS  ANALYSIS 


Courge 


Pees/fall 

Hill— 


St«e  of  sample 
Pinal  course 
grade 

_ _ 


Basic  supply  stock  clerk 

Personal  financial  records  clerk 

Basic  automotive  mechanic 

Advanced  automotive  mechanic 

Basic  baker 

Basic  food  service 

Basic  combat  engineer 

Basic  electrician 

Electrical  equipment  repairman 

Basic  engineer  equipment  mechanic 

Administrative  clerk 

Personnel  clerk 

Unit  diary  clerk 

Sea  duty  Indoctrination 

Basic  electronics 

Radio  fundamentals 

Field  radio  operator 

Communications  center  man 

Air  control  electronic  operator 

Infantry  training 

Tracked  vehicle  repair 

Baste  helicopter 

Aviation  structural  mechanic  (safety  equipment) 

Aviation  structural  mechanic  (hydraulics) 

Aviation  structural  mechanic  (structures) 

Aviation  ordnance 

Aviation  crash  crew 

Avionics  repairman 

Air  controlman 

Air  control  maintenance 

Aircraft  launch  and  recovery 

Air  crew  survival  equipment 

Marine  aviation  operations  (clerical) 

Aviation  maintenance  administration 
Marine  aviation  supply  (mechanical) 
Aerographers  mate 
Small  arms  repair 
Tank  crewman 

Field  artillery  fire  control 
Ammunition  storage 
Corrections  specialist 
Military  police 
Basic  cannoneer 

Basic  electricity  4  electronics 
Aviation  machinists  mate 
Avionics  technician 


1,241 

380 

1,316 

683 

168 

604 

941 

225 

218 

700 

1,420 

207 

166 

1,212 

1,132 

169 

1,260 

722 

89 

4,199 

252 

820 

125 

565 

627 

292 

296 

301 

91 

95 

95 

175 

250 

234 

534 

128 

324 

438 

485 

313 

223 

777 

204 

968 

233 

138 


997 

347 

1,264 

610 

158 

578 

927 

224 

213 

688 

1,323 

176 

148 

537 

992 

157 

1,217 

679 

73 

4,117 

233 

789 

123 

551 

592 

283 

294 

290 

76 

94 

247 

214 

494 

45 

323 

96 

306 


163 


Total 


26,039 
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Time  to 
complete 
(TIME) 


172 


968 

233 

138 


gave  satisfactory  results.*  For  this  reason  and  to  Increase  the  statis¬ 
tical  reliability  of  the  results,  we  conducted  the  validity  analysis 
only  on  the  33  FCG  schools  with  100  or  more  cases.  The  data  on  the 
remaining  13  schools  was  only  used  as  an  aid  In  setting  minimum  compos¬ 
ite  levels.  Individual  recruits  with  FCG  of  60  or  less  were  removed 
from  the  validity  analysis  because  these  grades  appeared  to  be 
arbitrarily  determined;  hence,  their  Inclusion  would  bias  the  results. 

Course  performance  data  for  the  first  A3  courses  in  table  A  was 
collected  directly  from  the  schools  on  optically  scannable  sheets. 

Course  data  for  the  remaining  three  courses  is  from  the  Navy  Integrated 
Training  Resource  and  Administration  System  (NITRAS).  All  aptitude  test 
data  is  from  the  Marine  Corps  Recruit  Accession  Management  System 
(RAMS). 

An  additional  source  of  data  was  FY  1980  course  failure  rates  (as 
distinguished  from  data  on  individual  recruits)  for  86  out  of  the  9A 
formal  training  courses  used  for  Marine  Corps  recruits.  This  data 
supplements  our  1977-1978  data  by  providing  a  more  recent  picture  of 
school  performance. 

ORGANIZATION  OF  THE  REPORT 

The  validity  of  the  individual  ASVAB  6/7  tests  is  addressed  in 
chapter  2,  and  that  of  the  composites  in  chapter  3.  In  chapter  A  we 
discuss  the  applicability  of  ASVAB  6/7  validity  results  for  the  new 
ASVAB  8/9/10.  In  chapter  5  we  examine  the  relationship  between  failure 
rates  in  service  courses  and  prerequiste  levels.  In  chapter  6  we 
develop  an  experimental  set  of  improved  composites  for  ASVAB  8/9/10. 


*  ASVAB  scores  generally  exhibited  lower  correlations  with  TIME  and  P/F 
then  they  did  with  FCG.  The  TIM5  variable  appeared  to  have  been 
administratively  predetermined  in  some  courses.  The  use  of  the  P/F 
variable  would  have  necessitated  corrections  for  restriction  of  range  on 
a  dichotomous  variable.  These  corrections,  which  will  be  discussed 
later,  are  not  satisfactory  on  dichotomous  variables.  For  these  reasons 
we  restricted  the  validity  part  of  our  analyses  to  those  courses  with  a 
FOG  criterion. 
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CHAPTER  2 


VALIDITY  OF  INDIVIDUAL  ASVAB  6/7  TESTS 


In  this  section  we  examine  the  validity  of  each  of  the  16  tests 
that  make  up  ASVAB  6/7.  These  tests  are  defined  in  table  1.  The 
validity  of  composites  will  be  examined  in  a  later  section.  Validity  is 
defined  as  the  correlation  between  a  performance  criterion  (in  this  case 
FCG)  and  scores  on  ASVAB  6/7.  Tests  that  exhibit  very  low  validity  do 
not  contribute  to  the  predictive  power  of  the  ASVAB  and  should  be  elimi¬ 
nated  or  replaced. 

VALIDITY  COEFFICIENTS 

Validity  coefficients  were  calculated  for  each  of  the  16  ASVAB  6/7 
tests  in  each  of  the  33  courses  examined.  The  coefficients,  uncorrected 
for  range  restriction,  are  tabulated  in  appendix  C.  These  coefficients 
must  be  corrected  for  range  restriction  before  they  are  interpreted. 

This  correction  is  discussed  in  the  following  paragraphs. 

The  desired  output  from  this  analysis  is  validity  data  that  is 
appropriate  to  use  with  the  entire  pool  of  recruits  available  for 
assignment.  Ideally  the  results  would  indicate  which  ASVAB  test  or 
tests  best  predicts  performance  in  each  school  and,  hence,  which  one  to 
use  in  assigning  recruits  to  each  school.  Operationally,  the  data  we 
collect  represents  school  performance  on  recruits  that  have  already 
attended  the  service  school.  They  were,  of  course,  selected  for 
assignment  to  that  school  on  the  basis  of  some  ASVAB  test.  As  a  result 
of  that  selection  the  scores  of  our  sample  of  recruits  will,  for  each 
course,  be  restricted  to  high  values  in  whatever  ASVAB  test  was  con¬ 
sidered  important  as  a  predictor  for  that  course.  This  "restriction  of 
range”  will  lower  the  observed  correlation  between  this  ASVAB  test  and 
school  performance  with  respect  to  what  it  would  have  been  had  we  been 
able  to  observe  the  performance  of  the  entire  recruit  population.  This 
lowering  of  the  correlation  will,  in  general,  affect  the  relative  size 
of  validity  coefficients  for  the  various  ASVAB  tests.  To  ascertain  the 
true  validities  of  each  ASVAB  test  we  must  correct  for  the  restriction 
of  range. 

We  make  this  correction  using  a  standard  multivariable  correction 
program,  developed  by  [7],  that  uses  the  methodology  of  Burt  [8],  The 
details  of  the  correction  are  given  in  appendix  D.  The  corrected 
validity  coefficients  are  shown  for  each  course  in  table  5.  From  table 
5  we  see,  for  example,  that  the  validity  coefficient  for  the  ASVAB  6/7 
MK  test  is  0.56  for  the  Supply  Stock  Clerk  course.  The  MK  coefficient 
is  the  highest  of  any  test  for  this  course,  which  indicates  that  the  MK 
test  is  the  best  predictor  of  success  in  training  as  a  supply  stock 
clerk. 


CORRECTED  VALIDITY  COEFFICIENTS3  FOR  INDIVIDUAL  ASVAB  6/7  TESTS 
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DISCUSSION 


In  interpreting  the  coefficients  in  table  5  it  is  well  to  bear  in 
mind  that  they  contain  statistical  uncertainties  ranging  from  0.01  to 
0.07.  These  are  a  function  of  the  number  of  recruits  in  each  course 
(appendix  E).  The  restriction  of  range,  described  earlier,  introduces 
additional  distortion  into  the  correlation  coefficients.  Some,  but  not 
all,  of  this  error  is  removed  during  the  range  correction  process 
described  in  appendix  D.  We  estimate  (see  appendix  D)  that  the  uncor- 
rectable  uncertainties  due  to  restriction  of  range  vary  from  0.00  to 
0.11.  These  uncertainties,  which  are  inherent  1 u  analysis  of  this  type, 
indicate  that  we  should  strive  for  a  general,  rather  than  a  highly 
specific,  interpretation  of  the  data.  They  also  indicate  that  a  few 
anomalous  results  should  not  be  surprising,  particularly  in  courses  with 
small  numbers  of  recruits. 

To  reduce  the  complexity  of  the  interpretation  of  table  5  we 
carried  out  stepwise  regression  analysis,*  using  success  in  the  course 
(FCG)  as  the  dependent  variable  and  the  test  data  corrected  for  restric¬ 
tion  of  range  as  the  independent  variables.  The  results  are  summarized 
in  table  6,  showing  the  best  combination  of  ASVAB  tests  for  each 
course.  The  order  of  presentation  of  the  best  tests  in  table  6  is  the 
order  in  which  they  entered  the  stepwise  regression.  The  multiple 
correlation  coefficient  at  each  step  in  the  regression  is  also  shown. 

For  example,  in  the  Supply  Stock  Clerk  Course  the  MK  test  was  most 
important  and  correlated  0.56  with  success  in  the  course.  The  second 
test  to  enter  the  regression  was  VK.  It,  in  combination  with  MK,  pro¬ 
duced  a  correlation  with  success  in  the  course  of  0.59.  The  third  test 
to  enter  the  regression  is  AR,  which  raises  the  multiple  correlation 
only  0.01  to  a  total  of  0.60.  Additional  tests  add  very  little  to  the 
multiple  correlation.  In  general,  the  data  of  table  6  shows  that 
success  in  training  courses  (as  measured  by  the  multiple  correlation 
coefficient)  can  be  predicted  reasonably  well  by  a  set  of  three  ASVAB 
tests.  Further,  we  see  that  in  general,  most  of  the  predictive  power  is 
manifest  in  the  first  test  of  the  three  to  enter  the  stepwise  regres¬ 
sion.  The  addition  of  the  two  additional  tests  adds  only  a  small  incre¬ 
ment  to  the  prediction. 

In  table  7  we  summarize  the  most  important  test  (first  one  entered 
in  stepwise  regression)  and  the  three  most  Important  tests  (first  three 
entered  in  stepwise  regression)  for  each  course.  The  tests  are  grouped 


*The  F-values  for  the  regressions  were  uniformly  high.  The  values  of 
the  constant  terms  were  reasonable  and  all  variables  shown  were 
significant  at  the  0.05  level.  All  variables  shown  entered  with 
positive  signs,  and  the  R^  values  generally  were  in  the  0.4  to  0.5 
range. 


TABLE  6 


COMBINATIONS  OF  CORRECTED  VALIDITY  COEFFICIENTS  FOR  INDIVIDUAL 

ASVAB  6/7  TESTS 


Court* 


Basic  supply  stock  clerk 

Personal  financial  records  clerk 

Basic  automotive  mechanic 

Advanced  automotive  mechanic 

Basic  baker 

Basic  food  service 

Basic  combat  engineer 

Basic  electrician 

Electrical  equipment  repairman 

Basic  engineer  equipment  mechanic 

Administrative  clerk 

Personnel  clerk 

Unit  diary  clerk 

Sea  duty  Indoctrination 

Basic  electronics 

Radio  fundamentals 

Field  radio  operator 

Communications  center  man 

Infantry  training 

Tracked  vehicle  repair 

Basic  helicopter 

Aviation  structural  mechanic  (safety  equipment) 

Aviation  structural  mechanic  (hydraulics) 

Aviation  structural  mechanic  (structures) 

Aviation  ordnance 

Aviation  crash  crew 

Avionics  repairman 

Aviation  operations  (clerical) 

Aviation  maintenance  administration 
Aviation  supply  (mechanical) 

Small  arms  repair 
Ammunition  storage 
Beale  cannoneer 

Mean 


Multiple  correlation^  for 
Indicated  number  of  tests 


Beat  coeblnatloo* 

of 

tests 

_ 

1 

JL 

3 

5 

W. 

WK. 

AR, 

GS, 

CA 

56 

59 

60 

60 

61 

KK, 

AR, 

CA, 

CC, 

NO 

62 

67 

68 

69 

69 

*i, 

MK, 

EI, 

SI, 

AR 

61 

68 

71 

72 

72' 

HC. 

AI. 

AR, 

GS, 

GI 

63 

69 

73 

74 

75 

MC, 

El. 

Aft 

55 

60 

62 

62 

62 

GS, 

AR, 

MK, 

SI, 

CC 

47 

53 

54 

55 

56 

MC, 

AR, 

EI. 

St, 

MC 

57 

64 

67 

68 

69 

MC. 

WK. 

AI. 

MK, 

CE 

44 

49 

51 

54 

55 

01, 

MC, 

CE 

39 

46 

47 

47 

47 

MC, 

At, 

MC. 

GI, 

CM 

53 

60 

64 

64 

65 

*. 

UK, 

NO, 

GS, 

CA 

54 

59 

60 

62 

62 

KK, 

NO, 

WK, 

CA, 

CM 

58 

61 

63 

65 

66 

mc. 

WK. 

CA 

59 

64 

66 

66 

66 

WK, 

HO, 

CS, 

MK, 

SI 

46 

52 

55 

56 

57 

*, 

El, 

CE, 

GS, 

NO 

60 

65 

66 

68 

69 

GS, 

NO, 

SI 

40 

45 

47 

47 

47 

MC, 

EI, 

WK, 

AR, 

AI 

48 

53 

55 

55 

56 

MK, 

UK, 

NO, 

AR, 

GI 

54 

60 

63 

64 

64 

GS, 

MC, 

GI, 

SP. 

NO 

30 

33 

35 

35 

36 

OS, 

AR, 

WK, 

MC, 

MK 

60 

67 

68 

70 

70 

MC, 

MC, 

AI, 

CI. 

MC 

51 

58 

63 

64 

64 

MK, 

EI, 

CM, 

WK, 

AO 

SO 

58 

61 

63 

64 

MC, 

CS, 

AR. 

SI. 

Ml 

58 

64 

66 

68 

69 

GS, 

MC, 

SI. 

AO, 

WK 

55 

61 

63 

64 

65 

*. 

GI, 

MC, 

GS 

53 

59 

62 

62 

62 

AR, 

EI. 

CC. 

GI 

41 

48 

49 

50 

50 

AR, 

EI, 

MC, 

<*, 

NO 

57 

67 

69 

70 

71 

MK, 

SP, 

HO, 

AR, 

AO 

46 

51 

53 

S3 

54 

MR, 

AR, 

GS 

56 

59 

60 

60 

60 

MK, 

UK, 

NO, 

01. 

AO 

58 

61 

63 

64 

65 

SP, 

AR, 

SI, 

AD, 

AI 

43 

49 

51 

53 

54 

OS, 

Cl, 

MC, 

si. 

UK 

55 

61 

64 

65 

66 

MC, 

GS 

49 

55 

55 

55 

55 

52 

58 

60 

61 

61 

1 J  n  order  entered  into  stepwise  regression* 

^Multiplied  by  100*  Some  regressions  terminated  before  five  tests  entered*  In  these  cases  the 
multiple  correlation  from  the  terminal  step  was  assumed  to  hold  for  all  remaining  steps* 
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TABLE  7 


RELATIVE  IMPORTANCE®  OF  INDIVIDUAL  ASVAB  6/7  TESTS 

Number  of  courses  for  which  the 
indicated  test  was: 


The  most 

One  of 

the  3  most 

Group 

Test 

important 

important 

MK 

15 

23  ] 

Math 

AR 

2 

*  17 

12  i 

42 

NO 

o  1 

7  J 

WK 

1  1 

| 

10  1 

Verbal 

GS 

6 

1  8 

10 

24 

GI 

1  J 

' 

4  j 

MC 

6  1 

8  ) 

El 

0 

8  1 

Shop 

SI 

0 

7 

3  1 

24 

AI 

1  , 

5  J 

Attitudinal 


CE 

CA 

CM 

CC 


6 


SP 

Miscellaneous  AD 


2 


®From  stepwise  linear  regression. 
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in  broad  content  areas.*  We  see  that  the  MK  test  is  by  far  the  most 
important  test  in  the  battery.  Tests  from  the  math,  verbal,  and  shop 
content  areas  are  seen  to  be  important  both  singly  and  in  groups  of 
three. 


Tests  in  the  attitudinal  and  miscellaneous  content  groups  are  seen 
to  only  be  important  for  a  few  courses.  The  tests  SI,  SP,  AD,  GI,  CE, 
CC,  CM,  and  CA  do  not  appear  to  be  critical  parts  of  the  ASVAB. 

The  remaining  parts  of  ASVAB  6/7  appear  to  be  useful  in  predicting 
school  performance  and  should  be  retained  in  the  battery.** 

The  validity  of  aptitude  composites  constructed  from  individual 
ASVAB  tests  will  be  examined  in  chapter  3. 


*  The  test  grouping  was  determined  by  a  factor  analysis  of  the  test 
battery.  This  analysis  will  be  discussed  in  a  later  section. 

**  Based  on  preliminary  results  from  this  analysis,  and  from  that  of 
other  service  personnel  research  groups,  it  was  decided  to  delete  GI, 

SP,  CA,  CC,  CE,  CM,  and  AD  from  the  new  ASVAB  8/9/10,  which  became 
operational  1  October  1980.  The  AI  and  SI  tests  were  replaced  in  ASVAB 
8/9/10  by  the  AS  test.  The  AS  test  contains  mostly  automotive  questions 
(like  AI)  and  only  a  few  shop  questions  (like  SI). 


CHAPTER  3 


VALIDITY  OF  ASVAB  6/7  COMPOSITES 


BACKGROUND 

The  placement  of  Individual  recruits  in  specific  service  schools  is 
determined,  in  part,  by  the  recruits'  scores  on  various  ASVAB  aptitude 
composites.  In  this  chapter  we  examine  the  validity  of  each  composite 
(see  table  3)  used  by  the  Marine  Corps.  For  purposes  of  comparison  we 
also  examined  the  validities  of  composites  used  by  the  Army,  Navy,  and 
Air  Force.  These  composites  are  formed  by  combinations  of  individual 
ASVAB  tests  and  are  defined  in  appendix  B. 

The  "differential"  nature  of  the  ASVAB  composites  will  be  a  factor 
in  our  examination  of  validities.  By  differential  we  mean  that  the 
composites  measure  specific  aptitudes  that  are  predictors  of  success  in 
specific  training  programs.  For  example,  if  a  recruit  scored  very  high 
in  mechanical  aptitude  and  low  in  other  areas  he  would  be  assigned  to  a 
training  program  leading  to  a  mechanical  job.  To  the  extent  that  dif¬ 
ferent  individuals  do  have  different  aptitudes  and  to  the  extent  that 
the  ASVAB  can  reliably  measure  these  aptitudes,  differential  composites 
expand41  the  existing  manpower  pool. 

We  have  considered  two  possible  approaches  to  analyzing  the 
validity  data.  One  of  these  approaches,  which  we  call  "course 
specific,"  involves  using  validity  data  to  pick  the  absolutely  "best" 
composite  (largest  validity  coefficient)  for  each  course.  The  other 
approach,  which  we  call  "global,"  uses  a  priori  judgment  to  group 
courses  with  apparently  similar  content.  A  composite  is  then  determined 
that  works  resonably  well  for  the  group  as  a  whole  and  the  results  are 
generalized  to  all  courses  in  the  group  as  well  as  any  courses  that  may 
later  be  added  to  the  group.  In  our  opinion  the  global  approach  is  the 
most  satisfactory.  The  reasons  for  this  conclusion  will  be  discussed 
later. 


*  This  expansion  is  illustrated  by  the  following  example.  Let  us  assume 
that  the  services  have  determined  that  only  recruits  of  above  average 
aptitude  will  be  suitable  for  a  group  of  courses  in  electrical, 
mechanical,  and  clerical  areas.  If  we  assigned  recruits  to  all  these 
courses  based  on  the  same  composite  (a  "general”  composite)  we  might 
find  that  only  50  percent  of  all  recruits  would  meet  the  assignment 
standards.  If  however,  we  have  separate  composites  for  electrical, 
mechanical,  and  clerical  courses  we  might  find  that  70  percent  of  all 
recruits  would  be  above  average  in  at  least  one  aptitude  area  and, 
hence,  qualified  for  a  course.  In  this  example  the  supply  of  qualified 
recruits  would  have  been  expanded  by  20  percentage  points. 


VALIDITY  COEFFICIENTS 


Validity  coefficients  for  each  composite  were  computed  for  each 
course  and  are  tabulated  (uncorrected  for  restriction  of  range)  In 
appendix  C.  The  coefficients  were  corrected  for  range  restriction  using 
the  methodology  described  in  appendix  D  and  are  tabulated  by  course 
content  area  in  table  8.  For  example,  the  correlation  between  success 
In  auto  mechanics  training  (final  course  grade)  and  the  ASVAB  6/7  GM 
composite  was  0.64.  The  approximate  standard  error  in  the  correlation 
coefficient  is  0.02.  The  courses  are  grouped  into  six  aptitude  areas 
based  on  a  priori  judgment.  The  mean  validity  for  each  composite  in 
each  aptitude  area  is  shown.  The  validities  of  the  composite  we  con¬ 
sider  to  be  most  appropriate  for  each  grouping  are  outlined  in  the 
table.  For  example,  we  consider  the  ASVAB  6/7  GM  composite  to  be  most 
appropriate  for  use  in  courses  in  the  mechanical  grouping;  the  EL  for 
those  in  the  electrical  grouping;  the  CL  for  those  in  the  clerical 
grouping;  the  FA  for  those  in  the  field  artillery  grouping;  CO  for  those 
in  the  combat  grouping;  and  GT  for  all  other  courses  (i.e.,  the  general 
grouping).  That  is  our  conclusion — now  let  us  turn  to  the  rationale. 

SELECTION  OF  THE  BEST  COMPOSITE 

Why  were  the  composites  chosen  as  outlined  in  table  8?  First,  let 
us  examine  the  question  of  whether  the  global  approach  or  the  course 
specific  approach  is  more  appropriate  for  selecting  the  best  composite 
for  each  course. 

The  coefficients  tabulated  in  table  8  are  only  approximately 
correct.  They  are  affected  by  statisitical  uncertainties,  which  are  a 
function  of  sample  size,  and  by  uncertainties  resulting  from 
inaccuracies  caused  by  range  restriction  that  can  be  only  partially 
corrected  by  the  range  correction  procedure.  The  statistical  uncer¬ 
tainties  can  be  calculated  and  are  shown  in  table  8.  The  uncertainties 
due  to  range  restriction  that  cannot  be  corrected  are  estimated  in 
appendix  D  to  range  from  0.00  to  0.11.  The  combined  effect  of  these 
sources  of  error  leads  to  validity  coefficients  that  are  somewhat  unre¬ 
liable — even  when  based  on  large  samples  of  data. 

The  uncertainty  in  the  validity  coefficients  is  compounded  by  the 
high  intercorrelations  among  the  composites  themselves  (see  table  9). 

For  example,  the  FA  and  ST  composites  correlate  0.97  with  the  EL  compos¬ 
ite.  This  implies  that  to  a  very  good  approximation,  these  three 
composites  measure  the  same  aptitude  and  are  not  really  different. 

The  uncertainty  in  the  validity  coefficients  and  the  high  intercor¬ 
relations  between  composites  produce  a  situation  in  which  the  simple 
assumption,  that  the  best  composite  is  the  one  with  the  largest  validity 
coefficient,  is  not  valid.  If  one  applies  the  course  specific  approach 
to  this  situation  one  validity  analysis  will  find  that  a  certain  compos¬ 
ite  is  the  "best**  for  a  particular  course.  If  a  second  validity 


CORRECTED  ASVAB  6/7  VALIDITY  COEFFICIENTS 
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TABLE  8  (Cont'd) 


analysis  is  conducted  on  the  same  course  a  different  "best"  composite 
may  be  deduced.  This  instability  of  validity  results  using  the  course 
specific  approach  is  illustrated  in  table  10.  This  table  compares  the 
composite  with  the  highest  validity  from  approximately  the  first  half  of 
our  data  sample  (1]  with  that  from  the  complete  data  sample.  Only  in  41 
percent  of  the  courses  would  the  course  specific  method,  picking  the 
composite  with  the  largest  coefficient,  have  given  the  same  result  for 
the  half  sample  and  the  complete  sample.  Instability  of  results  from 
the  course  specific  approach  would  result  in  the  frequent  and  capricious 
changing  of  course  prerequisites  without  any  real  improvement  in 
selection.  In  our  opinion  this  would  be  an  unsatisfactory  outcome  and 
for  this  reason  we  reject  the  course  specific  approach  in  favor  of  the 
global  approach.* 

Mechanical  Grouping 

The  global  approach  to  composite  selection  minimizes  the  effect  of 
uncertainty  in  validity  coefficients  by  averaging  them  over  a  number  of 
courses.  For  example,  in  table  8  we  see  that  the  mean  validity  coeffi¬ 
cient  for  GM  is  0.56.  This  is  the  highest  mean  validity  of  any  compos¬ 
ite  and  indicates  that  GM  Is  a  reasonable  choice  of  composite  for 
selection  into  mechanical  training  areas.  We  note  that  even  for  those 
mechanical  courses  for  which  GM  does  not  have  the  highest  validity, 
there  are  no  cases  in  which  an  alternative  composite  is  demonstrably 
better  when  uncertainties  in  coefficients  are  considered.  The  content 
areas  contained  in  GM  (see  table  3)  reflect  significant  mechanical 
aptitude.  Hence,  from  the  point  of  view  of  “face  validity"**  the  choice 
of  GM  is  also  appropriate.  A  comparison  of  the  validities  of  GM  and  MM 
(both  of  which  have  been  used  in  the  past  as  selectors  for  mechanical 
courses)  does  not  indicate  any  compelling  reason  to  use  MM  for  some 
mechanical  courses  and  GM  for  others.  Hence,  we  chose  GM  for  all 
mechanical  courses. 

It  is  readily  apparent  that  there  are  a  number  of  other  composites 
with  validities  almost  as  high  as  GM.  This  is,  however,  more  a  reflec¬ 
tion  on  the  number  of  highly  correlated  composites  than  on  the  appro¬ 
priateness  of  the  choice  of  GM  as  a  selector  composite  for  mechanical 
courses. 


*  An  application  of  the  global  approach  to  the  first  half  of  the  data 
produced  stable  results;  i.e.,  results  that  were  very  similar  to  those 
shown  in  table  8  for  the  full  data  sample. 

**  Face  validity  refers  to  validity  that  may  be  assumed  because  the  test 
content  is  clearly  related  to  aptitude  for  a  particular  course.  For 
example,  the  General  Maintenance  (GM)  composite  contains  the  Mechanical 
Comprehension  (MC)  test.  Clearly,  mechanical  comprehension  should  be 
expected  to  be  relevant  to  success  in  maintenance  courses;  hence,  the  GM 
composite  may  be  said  to  have  face  validity  for  these  courses. 


TABLE  10 


STABILITY  OF  COMPOSITE  SELECTION  BASED  ON  HIGHEST  VALIDITY 


Composite®  with 
highest  validity 


_ Area/course 

Mechanical 


First  half  Complete 
of  sample**  sample 


Basic  automotive  mechanic 

GM 

MM 

Advanced  automotive  mechanic 

GM 

GM 

Tracked  vehicle  repairman 

GT 

GCT 

Basic  helicopter 

GM 

GM 

Aviation  structural  mechanic  (safety  equipment) 

_c 

FA 

Aviation  structural  mechanic  (hydraulics) 

CO 

GM 

Aviation  structural  mechanic  (structures) 

ST 

EL 

Basic  engineer  equipment  mechanic 

GM 

GM 

Small  arms  repair 

CO 

CO 

Basic  combat  engineer 

GM 

GM 

Aviation  crash  crew 

MM 

EL 

Electrical 

Basic  electronics 

GT 

EL 

Radio  fundamentals 

_c 

EL 

Avionics  repairman 

EL 

GT 

Field  radio  operator 

EL 

EL 

Basic  electrician 

GM 

MM 

Electrical  equipment  repairman 

SC 

FA 

Clerical 

Administrative  clerk 

GT 

EL 

Personnel  clerk 

FA 

FA 

Unit  diary  clerk 

ST 

GT 

Basic  supply  stock  clerk 

FA 

FA 

Personal  financial  records  clerk 

GT 

ST 

Aviation  operations  (clerical) 

CO 

GCT 

Aviation  maintenance  administration 

GT 

EL 

Aviation  supply  (mechanical) 

EL 

FA 

Communications  center  man 

ST 

ST 

Field  artillery 

Basic  cannoneer 

_c 

GM 

TABLE  10  (Cont’d) 


_ Area/Course _ 

Combat 

Infantry  training 
Sea  duty  Indoctrination 

General 

Ammunition  storage 
Aviation  ordnance 
Basic  baker 
Basic  food  service 


Composite®  with 
highest  validity 

First  half  Complete 
of  sample"  sample 


EL 

EL 

_c 

FA 

EL 

FA 

GT 

EL 

EL 

EL 

EL 

EL 

^Marine  Corps  composites  only. 
“Taken  from  [1J . 
cData  not  available. 


Electrical  Grouping 


The  naan  validity  of  the  EL  composite  for  the  electrical  grouping 
is  0.48  (table  8).  Both  the  EL  and  FA  composites  have  equally  high 
validities  for  this  group;  but  this  is  not  surprising  given  their  high 
intercorrelations  (table  9).  Clearly,  either  FA  or  EL  could  be  used  for 
this  group,  but  because  EL  was  designed  specifically  for  such  courses  it 
seems  the  most  reasonable  choice.  Reference  to  table  3  shows  that  the 
EL  composite  has  face  validity  as  a  selector  for  electrical  (and 
electronics)  courses. 

The  EL  composite  is  a  highly  effective  predictor  of  school  perform¬ 
ance.  It  may  even  be  said  to  be  “too  good"  in  that  it  has  the  highest 
or  near  highest  mean  validity  coefficient  for  every  grouping  in  table 
8.  However,  its  high  level  math  content  (MK)  should  not  be  wasted  on 
job  areas  for  which  a  lower  level  math  ability  would  suffice.  For  this 
reason  its  use  should  be  restricted  to  the  electrical  grouping 

Clerical  Grouping 

From  table  8  we  see  that  the  CL  composite  with  mean  validity  of 
0.50  is  a  reasonable  choice  as  a  selector  composite  for  the  clerical 
grouping.  Although  the  mean  validity  for  CL  is  not  quite  as  high  as 
that  of  EL,  FA,  and  ST,  it  is  satisfactory  and  Its  choice  both  preserves 
and  Illustrates  the  differential  character  of  the  battery.  Reference  to 
the  electrical  grouping  of  table  8  shows  that  EL  (validity  of  0.48)  is  a 
significantly  better  predictor  for  electrical  courses  than  CL  (validity 
of  0.39).  For  clerical  courses  CL  (validity  of  0.50)  is  almost  as  good 
as  EL  (validity  of  0.52).  By  selecting  recruits  for  electrical  courses 
on  EL  and  clerical  courses  on  CL  we  will,  in  general,  get  better  overall 
school  performance*  from  the  same  manpower  pool  than  had  we  selected 
recruits  for  both  groupings  on  EL  alone. 

Field  Artillery 

Only  one  course  was  available  for  study  in  the  field  artillery 
area.  The  composite  designed  for  field  artillery  (FA)  Is  a  reasonable 
selector  because  its  validity  (0.46),  although  not  the  highest,  is 
within  the  expected  range  of  uncertainty  (approximately  one  standard 
error) . 


*The number  of  recruits  with  high  EL  (or  CL)  scores  is  limited  If  we 
assigned  recruits  to  both  electrical  and  clerical  schools  on  the  basis 
of  EL  scores  we  would  probably  deplete  the  supply  of  recruits  with  high 
EL  scores.  This  would  result  In  either  empty  school  seats  or  the 
assignment  of  below  average  recruits  to  some  electrical  or  clerical 
courses,  thereby  lowering  overall  performance. 
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•  if* 


There  Is  some  question  about  a  real  need  for  a  separate  field 
artillery  composite.  This  question  should  be  explored  further  In  subse¬ 
quent  validity  analyses. 

Combat 


All  composites  have  rather  low  validity  for  the  combat  area.  This 
result  may  indicate  that  the  criterion  variable  Is  poorly  defined.  In 
any  event,  the  mean  validity  (0.36)  of  the  combat  composite  (CO)  Is  not 
much  worse  than  that  of  the  other  composites.  We  recommend  Its  con¬ 
tinued  use  pending  further  validity  analysis  and  an  examination  of  other 
criterion  variables  such  as  job  performance  measures. 

General 


Courses  In  the  general  area  are  by  definition  those  that  do  not 
belong  to  any  well  defined  group.  An  examination  of  table  8  discloses 
that  the  highest  mean  validities  are  associated  with  GM,  EL,  and  the  EL 
surrogates,  i.e.,  FA  and  ST.  To  choose  any  of  these  as  the  selector  for 
this  grouping  would  reduce  their  effectiveness  In  their  specialty 
areas.  We  recommend  the  use  of  GT  (validity  0.46)  for  this  area.  The 
recommendation  Is  primarily  based  on  face  validity  considerations,  i.e., 
the  course  content  seems  to  require  the  ability  to  read  and  that  Is 
measured  well  by  GT. 

Comparison  of  Current  and  Proposed  Composites 

A  comparison  of  currently  used  aptitude  composites  and  those  pro¬ 
posed  for  ASVAB  6/7  from  this  analysis  Is  given  In  table  11.  It  is  seen 
that  the  changes  proposed  are  not  radical.  The  proposal  Is  really 
simply  to  use  the  composites  that  are  designed  for  a  content  area  as 
selectors  in  all  courses  that  seem  to  belong  in  that  content  area  unless 
very  strong  and  reproducible  evidence  can  be  cited  to  show  them  to  be 
unsatisfactory. 

These  validity  results  can  be  generalized  to  courses  other  than 
those  listed  by  simply  placing  the  course  in  the  appropriate  grouping 
and  using  the  aptitude  composite  for  that  grouping. 

MULTIPLE  COMPOSITES 

Some  courses  currently  use  multiple  commposites  as  prerequisites 
(for  example,  GT  and  EL).  Apparently,  the  Idea  Is  that  If  one  composite 
Is  good  then  two  should  be  even  better.  The  facts  are  that  two  are,  of 
course,  better — but  only  a  little  better,  and  the  cost  of  the  additional 
composite  is  very  high. 

We  examined  the  effect  of  multiple  composites  on  validity  using 
stepwise  regression  analysis.  Table  12  summarizes  the  validity  coeffi¬ 
cients  obtained  from  the  "best”  single  composite  and  the  best  two 
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TABLE  11 


COMPARISON  OF  CURRENT  AND  PROPOSED  ASVAB  6/7 
APTITUDE  COMPOSITES 


ASVAB  6/7  aptitude 
_ composite 


Area/course  Current3 

Proposed 

Mechanical 

1 

Basic  automotive  mechanic 

MM 

GM 

Advanced  automotive  mechanic 

MM 

GM 

Tracked  vehicle  repairman 

MM 

GM 

Basic  helicopter 

GM 

GM 

Aviation  structural  mechanic  (safety  equipment).'* 

GM 

GM 

Aviation  structural  mechanic  (hydraulics) 

GM 

GM 

Aviation  structural  mechanic  (structures) 

GM 

GM 

Basic  engineer  equipment  mechanic 

MM 

GM 

Small  arms  repair 

GM 

GM 

Combat  engineer 

GT 

GM 

Aviation  crash  crew 

GM 

GM 

Electrical 

Basic  electronics 

GT 

EL 

Radio  fundamentals 

GT 

F.L 

Avionics  repairman 

GT 

EL 

Field  radio  operator 

EL 

EL 

Basic  electrician 

EL 

EL 

Electrical  equipment  repairman 

EL 

EL 

Clerical 

Administrative  clerk 

CL 

CL 

Personnel  clerk 

CL 

CL 

Unit  diary  clerk 

CL 

CL 

Basic  supply  stock  clerk 

CL 

CL 

Personal  financial  records  clerk 

CL 

CL 

Aviation  operations  (clerical) 

CL 

CL 

Aviation  maintenance  administration 

CL 

CL 

Aviation  supply  (mechanical) 

CL 

CL 

Communications  center  man 

CL 

CL 

Field  artillery 

Basic  cannoneer 

FA 

FA 
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TABLE  11  (Cont'd) 


ASVAB  6/7 

aptitude 

composite 

—  Area/course 

Current® 

Combat 

Proposed 

Infantry  training 

Sea  duty  Indoctrination 

CO 

CO 

CO 

CO 

General 

Ammunition  storage 

Aviation  ordnance 

GT 

GT 

Basic  baker 

EL 

GT 

Basic  food  service 

GT 

GT 

GT 

GT 

Taken  from  Recruit  Distribution  Model 

dictionary  of  27  January  1981. 
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TABLE  12 


COMBINATIONS3  OF  CORRECTED  VALIDITY  COEFFICIENTS^ 
FOR  ASVAB  COMPOSITES 


Validity  of 

Best  Belt  Best  combinations  of: 

predictive  two  three 


Course 

compos lea 

composites 

cowa.lt*. 

One 

IVo 

Three 

Basic  supply  stock  clerk 

FA 

FA,  GT 

FA,  GT,  SC 

SA 

55 

56 

Personal  financial  records  clerk 

ST 

ST,  CT 

ST,  GT,  CO 

58 

61 

62 

Basic  automotive  eechanlc 

m 

MM,  CM 

MM,  GM,  OF 

65 

67 

68 

Advanced  automotive  eechanlc 

CM 

cm,  m 

GM,  Ml,  CO 

66 

67 

68 

Basic  baker 

EL 

EL,  GCT 

EL,  GCT,  GM 

58 

59 

59 

Basic  food  service 

EL 

EL,  CO 

EL,  CO,  GCT 

56 

57 

57 

Combat  engineer 

CM 

GM,  FA 

GM,  FA,  CO 

66 

67 

67 

Basic  electrician 

MM 

MM,  GT 

Ml,  GT,  GCT 

45 

48 

49 

Electrical  equipment  repairman 

FA 

FA,  GT 

FA,  GT,  CL 

38 

39 

42 

Basic  engineer  equipment  mechanic 

CM 

GM,  SC 

GM,  SC,  GCT 

62 

64 

65 

Administrative  clerk 

EL 

el,  a 

EL,  CL,  GT 

55 

58 

58 

Personnel  clerk 

FA 

pa,  a 

FA,  CL,  OF 

56 

58 

58 

Unit  diary  clerk 

GT 

GT,  FA 

GT,  FA,  GM 

56 

57 

58 

Sea  duty  Indoctrination 

FA 

FA,  CL 

fa,  a,  Mf 

48 

50 

50 

Basic  electronics 

EL 

EL,  CT 

EL,  CT,  FA 

61 

63 

63 

Radio  fundamentals 

EL 

EL,  CT 

EL,  CT,  CL 

44 

46 

49 

Field  radio  operator 

EL 

el,  a 

EL,  CL,  GM 

49 

51 

52 

Coaaunlcatlon  center  man 

ST 

ST.  CT 

ST,  CT,  FA 

55 

57 

57 

Infantry  training 

EL 

EL,  CO 

EL,  CO,  OF 

54 

35 

36 

Tracked  vehicle  repair 

act 

GCT,  SC 

GCT,  SC,  GM 

75 

87 

94 

Basic  helicopter 

CM 

GM,  FA 

GM,  FA,  Mf 

54 

56 

57 

Aviation  structural  mechanic  (safety  equipment) 

FA 

FA,  00 

tk,  CO,  CT 

52 

55 

56 

Aviation  structural  mechanic  (hydraulics) 

CM 

GM,  00 

GM,  CO,  SC 

60 

62 

62 

Aviation  structural  mschanlc  (structures) 

EL 

EL,  CL 

EL,  CL,  Mf 

53 

55 

56 

Aviation  ordnance 

EL 

EL.  GCT 

EL.  GCT,  Ml 

52 

53 

55 

Aviation  crash  crew 

EL 

EL,  CO 

EL,  CO.  Mf 

46 

48 

49 

Avionics  repairman 

CI 

CI.  1*! 

GT,  Mf,  EL 

62 

66 

66 

Aviation  operations  (clerical) 

GCT 

GCT,  GT 

GCT,  GT,  CL 

47 

51 

54 

Aviation  maintenance  admlnstratlon 

EL 

EL,  CT 

EL,  GT,  OF 

52 

54 

54 

Aviation  supply  (mechanical) 

FA 

fa,  a 

FA,  a,  ST 

58 

60 

61 

Small  arms  repair 

CO 

CO,  sc 

CO,  SC,  GT 

49 

50 

52 

Ammunition  storage 

FA 

FA,  CO 

PA,  00,  OF 

57 

59 

60 

Basic  cannoneer 

Mean 

CM 

CM,  ST 

CM,  ST,  SC 

53 

54 

SI 

57 

_55_ 

58 

*Proe  stepwise  regression  analysis  of  ASVAB  composites  used  by  the  Marine  Corps 
"Multiplied  by  100. 


and  three  composite  combinations  (best  in  this  context  means  highest 
validity  coefficient).  The  mean  value  of  the  best  single  composite  was 
0.54.  The  best  two-composite  and  three-composite  combinations  gave  mean 
validities  of  0.57  and  0.58,  respectively.  This  small  Increase  in 
predictive  power  is  achieved  at  the  cost  of  a  greatly  reduced  pool  of 
recruits  qualified  for  courses  (table  13).  The  use  of  two  selector 
composites  instead  of  one  typically  reduces  the  qualified  pool  by  20  to 
40  percent.  If  the  procedure  is  used  for  one  course,  that  one  course 
may  achieve  slightly  better  performance  at  the  expense  of  reduced 
performance  in  the  other  courses.  If  all  courses  use  the  multiple 
composite  procedure  it  negates  the  benefits  of  a  differential  test 
battery  and  becomes  self-defeating.  We  recommend  the  use  of  one  and 
only  one  composite  for  selection  to  schools. 


TABLE  13 

ILLUSTRATION  OF  EFFECT  OF  MULTIPLE  COMPOSITES  ON 
SUPPLY  OF  ELIGIBLE  RECRUITS 


Percentage  reduction 
in  eligible  recruits 

Percentage  of 

due  to  multiple 

Selection 

recruits  eligible3 

requirements 

EL  i.  100 

46.6 

EL  and  GT  >  100 

36.6 

21.4 

EL  >  120 

13.9 

EL  and  GT  >  120 

8.7 

37.4 

aSample  of  26,666  high  school  graduate  Marine  Corps  recruits  enlisted  in 
CY  1979. 

'’Percentage  reduction  from  number  eligible  with  single  composite 
requirement. 


OTHER  SERVICE  COMPOSITES 

A  comparison  of  the  validity  of  composites  used  by  the  Marine 
Corps*  with  those  of  other  services  is  given  in  table  14.  The  mean 
validities  for  Marine  Corps  and  Army  composites  were  0.54,  which  com¬ 
pares  well  with  the  mean  of  0.50  for  the  Air  Force  and  0.56  for  Navy 
composites. 


*  There  is  almost  total  overlap  in  the  sets  of  composites  used  by  the 
Army  and  Marine  Corps  so  the  results  for  these  two  services  were 
combined. 


TABLE  14 


LARGEST  CORRECTED  VALIDITY 
FROM  EACH  SERVICE  SET  OF 

Course 

COEFFICIENTS8 

COMPOSITES 

Marine 

Corps/ 

Army 

Air 

Force 

Navy 

Basic  supply  stock  clerk 

54 

45 

57 

Personal  financial  records  clerk 

58 

51 

62 

Basic  automotive  mechanic 

65 

64 

65 

Advanced  automotive  mechanic 

66 

63 

69 

Basic  baker 

58 

52 

60 

Basic  food  service 

56 

50 

55 

Basic  combat  engineer 

66 

64 

65 

Basic  electrician 

45 

44 

49 

Electrical  equipment  repairman 

38 

30 

38 

Basic  engineer  equipment  mechanic 

62 

60 

59 

Administrative  clerk 

55 

52 

57 

Personnel  clerk 

56 

52 

54 

Unit  diary  clerk 

56 

46 

55 

Sea  duty  indoctrination 

48 

51 

50 

Basic  electronics 

61 

46 

67 

Radio  fundamentals 

44 

31 

47 

Field  radio  operator 

49 

49 

53 

Communication  center  man 

55 

52 

57 

Infantry  training 

34 

32 

34 

Tracked  vehicle  repair 

75 

67 

66 

Basic  helicopter 

55 

52 

58 

Aviation  structural  mechanic  (safety  equipment)  52 

47 

55 

Aviation  structural  mechanic  (hydraulics) 

60 

60 

65 

Aviation  structural  mechanic  (structures) 

53 

52 

58 

Aviation  ordnance 

52 

44 

58 

Aviation  crash  crew 

46 

49 

44 

Avionics  repair 

62 

49 

68 

Aviation  operations  (clerical) 

47 

46 

42 

Aviation  maintenance  administration 

52 

52 

57 

Aviation  supply  (mechanical) 

58 

55 

58 

Small  arms  repair 

49 

50 

42 

Ammunition  storage 

57 

55 

61 

Basic  cannoneer 

53 

48 

5T 

Mean 

54 

50 

56 

Multiplied  by  100. 
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VALIDITY  OF  AFQT 

Three  tests  In  ASVAB  6/7  are  combined  to  form  the  Armed  Forces 
Qualification  Test  (AFQT)  score.  This  score  has  traditionally  been  used 
by  the  services  as  a  measure  of  general  trainability .  The  AFQT  score  is 
also  the  basis  of  the  AFQT  mental  categories  on  which  the  general  over¬ 
all  mental  ability  of  service  personnel  is  reported  to  Congress. 

Recently  the  AFQT  score  has  been  criticized  as  having  no  value  as  a 
predictor  of  success  in  military  occupations  [9] .  In  light  of  this 
allegation,  we  examined  the  predictive  power  of  the  AFQT  part  of  the 
battery.  Because  the  AFQT  score  is  simply  the  GCT  composite  expressed 
in  percentile  score  form,  the  validity  coefficients  already  calculated 
for  GCT  (table  8)  will  also  apply  to  AFQT.  We  express  predictive  power 
as  the  square  of  the  validity  coefficient  for  AFQT  as  a  percentage  of 
the  square  of  the  largest  validity  coefficient  of  all  11  composites  in 
table  8.  The  results  are  summarized  in  table  15.  A  conservative 
estimate  is  that  at  least  80  percent  of  the  predictive  power  of  the 
entire  ASVAB  is  contained  within  the  AFQT  component.  Allegations  that 
AFQT  is  useless  appear  to  be  without  foundation. 


TABLE  15 


PREDICTIVE  POWER  OF  AFQT 


Mean  validity 
coefficient3 

Percentage  of  predictive 

Group  Largest  AFQTb  power  of  battery  in  AFQTC 


Mechanical 

56 

Electrical 

48 

Clerical 

53 

Field  artillery 

53 

Combat 

41 

General 

56 

Mean 


53 

89 

45 

88 

51 

93 

48 

82 

36 

77 

47 

70 

83 

aFrom  table  8. 

'’AFQT  is  made  up  of  the  same  tests  as  GCT. 


'/Square  of  AFQT  validity  coefficient  \ 
\Square  of  largest  validity  coefficient / 


x  100 


EFFECT  OF  EDUCATION,  RACE,  AND  SEX  ON  VALIDITY 

Ideally,  ASVAB  scores  should  predict  performance  equally  for  all 
groups  in  the  population.  Because  this  goal  is  not  easily  attainable  it 
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Is  reasonable  to  examine  ASVAB  in  this  context .  To  the  extent  that 
individuals  with  identical  ASVAB  scores,  but  different  personal  charac¬ 
teristics,  perform  differently  in  courses,  the  ASVAB  may  be  said  to 
underpredict  success  for  some  groups.  Underprediction  for  a  certain 
group  is  commonly  referred  to  as  test  bias  against  that  group. 

Underprediction  is  illustrated  in  figure  1.  The  solid  lines  repre¬ 
sent  the  relationship  usually  observed  between  performance  in  training 
courses  and  ASVAB  scores  (in  this  instance  the  GT  composite  is  shown). 
Separate  lines  are  shown  for  high  school  graduates  and  non-high  school 
graduates.  Ideally  the  two  lines  should  fall  on  top  of  one  another.  In 
this  illustration  they  do  not;  hence,  we  have  underprediction  for  high 
school  graduates.  Reference  to  figure  1  shows  that  recruits  with  GT 
scores  of  100  will  achieve  a  final  course  grade  of  about  80  (if  they  are 
non-high  school  graduates)  and  about  87  (If  they  are  high  school 
graduates).  High  school  graduates  will  outperform  non-high  school 
graduates  with  the  same  GT  score.  For  this  reason  the  ASVAB  may  be  said 
to  underpredict  the  performance  of  high  school  graduates  (or  alternately 
to  overpredict  the  performance  of  non-high  school  graduates). 

In  appendix  F  we  examine  the  relationship  between  course  perform¬ 
ance,  ASVAB  scores,  civilian  educational  level,  race,  and  sex.  The 
effects  found  (after  controlling  for  ASVAB  scores)  are  summarized  in 
table  16.  The  analysis  is  restricted  to  those  courses  with  100  or  more 
cases  in  each  population  group  of  Interest.  The  analysis  indicates  that 
course  performance  of  high  school  graduates  is  underpredicted  for  almost 
every  course.  The  mean  equivalent  composite  score  points  of  underpre¬ 
diction  is  13.  This  means  that,  on  the  average,  high  school  graduates 
perform  like  nongraduates  who  are  13  points  more  able  as  measured  by  the 
appropriate  ASVAB  composite.  Because  of  the  size  and  consistency  of  the 
effect  we  recommend  that  compensating  action  be  taken  in  recruit 
assignment . 

The  situation  with  respect  to  a  possible  racial  effect  is  less 
clear.  In  about  half  of  the  courses  examined  no  racial  effect  was 
found.  In  the  other  half  of  the  courses  the  ASVAB  was  found  to  under- 
predLct  the  performance  of  whites.  Because  the  average  effect  of  the 
underprediction  is  small  and  not  consistent  over  all  courses,  we  recom¬ 
mend  that  no  corrective  action  be  taken.  The  data  are  conclusive, 
however,  that  the  ASVAB  is  not  biased  against  minorities. 

Because  there  were  only  two  courses  with  sufficient  female  recruits 
for  analysis  no  definitive  conclusions  can  be  drawn  with  regard  to 
underpredition  by  sex.  In  one  of  the  two  courses  a  significant 
underprediction  of  female  performance  was  found — in  the  other  it  was 
not.  Because  the  overall  effect  is  small  and  not  consistent  over  all 
courses,  we  recommend  that  no  corrective  action  be  taken. 


Final  course  grade 


mm 


FIG.  1:  ILLUSTRATION  OF  UNDERPREDICTION 
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TABLE  16 


EFFECT  OF  CIVILIAN  EDUCATION,  RACE,  AND  SEX 
ON  COURSE  PERFORMANCE 


Variable 

Number  of 
courses8 

Number  of 

courses 

in  which 
variable  was 
significant 

Mean 

equivalent 
composite  score 
points2*  under¬ 
predicted 

Group  for 
which  per¬ 
formance  is 
underpredicted 

Education 

16 

15 

13 

Graduates 

Race 

15 

8 

6 

Whites 

Sex 

2 

1 

4 

Females 

aCourses  In  which  each  population  group  contained  100  or  more  cases. 
^Significant  at  the  99  percent  confidence  level. 

cNumber  of  composite  score  points  to  which  membership  in  the  better 
performing  group  is  equivalent. 

“In  computing  the  mean,  courses  for  which  the  variable  was  not  signi¬ 
ficant  were  assigned  zero  equivalent  score  points. 
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CHAPTER  4 


ESTIMATED  VALIDITY  OF  ASVAB  8/9/IO  COMPOSITES 


All  the  validity  data  used  in  this  analysis  is  based  on  ASVAB  6/7 
test  scores.  ASVAB  6/7  was  replaced  at  the  AFEES  by  ASVAB  8/9/10  on 
1  October  1980.  For  this  reason  the  results  of  this  analysis  are 
primarily  of  interest  to  the  extent  that  they  can  be  generalized  to 
apply  to  ASVAB  8/9/10. 

To  evaluate  the  generalizability  of  our  results  we  first  compare 
the  tests  in  ASVAB  6/7  with  those  in  ASVAB  8/9/10.  We  then  examine  the 
comparability  of  liked-named  composites  in  the  two  batteries.  Last,  we 
simulate  ASVAB  8/9/10  composites  in  our  ASVAB  6/7  data  set  and  use 
scores  on  these  simulated  composites  to  estimate  ASVAB  8/9/10  validities 
for  representative  courses. 

The  structure  of  ASVAB  8/9/10  is  summarized  in  table  17. 


TABLE  17 


THE  STRUCTURE  OF  ASVAB  8/9/10 

Number  of 

Testing  time 

Subtest 

Content  area 

questions 

(minutes) 

GS 

General  Science 

25 

11 

ARa 

Arithmetic  Reasoning 

30 

36 

WKa 

Word  Knowledge 

35 

11 

PCa 

Paragraph  Comprehension 

15 

13 

NOa 

Numerical  Operations 

50 

3 

CS 

Coding  Speed 

84 

7 

AS 

Auto  and  Shop  Information 

25 

11 

MK 

Mathematics  Knowledge 

25 

24 

MC 

Mechanical  Comprehension 

25 

19 

El 

Electronics  Information 

20 

_9 

334 

144 

aThese  tests 

comprise  the  AFQT  part  of  the 

battery: 

AFQT  «  AR  +  WK  +  PC  +  (^)  . 
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COMPARISON  OF  ASVAB  6/7  AND  ASVAB  8/9/10  TESTS 

A  comparison  of  Che  test  structure  of  the  two  batteries  is  given  in 
table  18.  Based  on  validity  information  available  in  1979  the  ASVAB 
Working  Group*  restructured  the  ASVAB  by  eliminating  those  test  content 
areas  that  appeared  to  add  little  or  no  unique  predictive  power  to  the 
battery  (GI,  AD,  SP,  CC,  CA,  CE,  and  CM).  The  battery  was  strengthened 
by  adding  the  Paragraph  Comprehension  (PC)  test  and  the  Coding  Speed 
(CS)  test.  The  tests  in  ASVAB  8/9/10  generally  contain  a  larger  number 
of  items  than  did  the  like-named  test  in  ASVAB  6/7. 


TABLE  18 

COMPARISON  OF  STRUCTURE  OF  ASVAB  6/7  AND  ASVAB  8/9/10 


Content  area 

Symbol 

Present  in 
ASVAB  8/9/10 

Present  in 
ASVAB  6/7 

General  Science 

GS 

/ 

/ 

Arithmetic  Reasoning 

AR 

✓ 

✓ 

Word  Knowledge 

IK 

/ 

/ 

Paragraph  Comprehension 

PC 

✓ 

(Verbal  -  PC  +  HI) 

VE 

/ 

Numerical  Operations 

NO 

/ 

/ 

Coding  Speed 

CS 

/ 

/a 

Auto  &  Shop  Information 

AS 

✓ 

Mathematics  Knowledge 

MK 

/ 

/ 

Mechanical  Comprehension 

MC 

/ 

/ 

Electronics  Information 

El 

/ 

/ 

General  Information 

GI 

/ 

Attention  to  Detail 

AD 

✓ 

Spacial  Perception 

SP 

/ 

Combat  Scale 

CC 

/ 

Attentiveness  Scale 

CA 

✓ 

Electronics  Scale 

CE 

/ 

Maintenance  Scale 

CM 

✓ 

aIn  ASVAB  6/7,  Auto  and  Shop  Information  were  scored  separately. 


*  A  joint  service  group  that  deals  with  ASVAB  Issues.  It  is  composed  of 
one  policy  and  one  technical  representative  from  each  service. 


The  tests  that  were  retained*  in  ASVAB  8/9/10  exhibit  correlations 
of  approximately  0.8  with  like-named  tests  in  ASVAB  6/7  (table  19). 
Because  most  of  the  tests  in  ASVAB  6/7  were  rather  short  (only  20  items) 
this  level  of  correlation  appears  to  be  very  satisfactory. 


TABLE  19 


CORRELATIONS  BETWEEN  LIKE-NAMED 


TESTS 

IN  ASVAB  6/7  AND 

ASVAB  8/9/10 

Tests 

Correlation3 

ASVAB  6/7 

:  ASVAB  8/9/10 

coefficient 

GS 

GS 

0.81 

AR 

AR 

0.86 

WK 

VE 

0.87 

NO 

NO 

0.78 

AI/SI 

AS 

0.80b 

MK 

MK 

0.84 

MC 

MC 

0.81 

El 

El 

0.78 

aComputed  from  a  stratified  sample  of  2,025  applicants 
from  all  services  tested  at  AFEES. 

“Computed  as  the  mean  of  correlations  for  AI:AS  of  0.83 
and  SI: AS  of  0.77. 


Test  content  areas  that  demonstrated  validity  were  retained  in  the 
transition  from  ASVAB  6/7  to  ASVAB  8/9/10.  ASVAB  8/9/10  tests  correlate 
well  with  the  like-named  ASVAB  6/7  tests  in  each  content  area. 

Therefore  we  expect  that  the  potential  validity  of  ASVAB  8/9/10  should 
be  as  good  as  that  of  ASVAB  6/7-perhaps  even  somewhat  better  due  to  the 
addition  of  PC  and  CS . 


*  Actually  only  the  content  areas  were  retained.  The  tests  themselves 
were  replaced  with  like-named  tests  containing  similar  (but  not 
Identical)  questions. 
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COMPARISON  OF  ASVAB  6/7  AND  ASVAB  8/9/10  COMPOSITES 


Recruit  assignments  are  made  on  the  basis  of  scores  achieved  on 
ASVAB  composites*  For  this  reason  the  validity  actually  realized  from 
the  battery  depends  on  the  validity  of  the  composites* 

Because  some  of  the  tests  in  ASVAB  6/7  were  eliminated  with  the 
transition  to  ASVAB  8/9/10,  the  new  aptitude  composites  are  defined 
differently.  Based  on  information  available  in  1979  [1,  2,  and  3]  the 
Marine  Corps  chose  a  set  of  interim  composite  definitions  for  ASVAB 
8/9/10.  The  test  content  of  the  ASVAB  8/9/10  composites  is  compared 
with  that  of  like-named  ASVAB  6/7  composites  in  table  20. 


TABLE  20 


COMPARISON  OF  USMC  ASVAB  6/7  AND  ASVAB  8/9/10  COMPOSITE  STRUCTURE 

_ Test  content  of  composites'  ___ 


Composite 


General  Maintenance 

Mechanical  Maintenance 

Electronics 

Clerical 

Field  Artillery 

Combat 

General  Technical 
General  Classification 
Test 


Symbol  ASVAB  8/9/10 


GM 

GS 

+ 

MK 

+ 

AS 

+ 

El 

MM 

AR 

♦ 

AS 

+ 

MC 

+ 

El 

EL 

GS 

+ 

AR 

+ 

MK 

+ 

El 

CL 

VE 

NO 

+ 

CS 

FA 

VE 

+ 

AR 

+ 

AS 

CO 

VE 

+ 

NO 

+ 

AS 

GT 

VE 

+ 

AR 

GCT 


ASVAB  6//a 


GS 

+ 

AR 

+ 

MC 

+ 

AI 

MK 

+ 

SI 

+ 

AI 

+ 

El 

CM 

GS 

+ 

AR 

♦ 

MK 

+ 

El 

WK 

+ 

AR 

+ 

AD 

CA 

GI 

+ 

AR 

+ 

MK 

+ 

El 

+ 

CA 

AR 

SI 

SP 

+ 

AD 

4- 

CC 

WK 

+ 

AR 

WK 

+ 

AR 

SP 

aThe  composites  OF,  ST,  and  SC  were  computed  for  ASVAB  6/7  but  not 
actually  used  in  recruit  assignment.  For  ASVAB  8/9/10  they  are  not 
computed. 

kNot  computed  for  ASVAB  8/9/10. 


The  definitions  of  the  ASVAB  8/9/10  composites  appear  to  differ 
significantly  from  those  of  the  like-named  ASVAB  6/7  composites.  This 
difference  is,  however,  not  as  large  as  it  appears.  The  like-named 
composites  do  tap  similar  content  areas  and  correlate  reasonably  well. 


Correlations  between  ASVAB  6/7  and  ASVAB  8/9/10  composites  are 
shown  In  table  21.  In  chapter  3  we  concluded  that  GM  and  MM  were  not 
both  necessary  for  mechanical  courses  and  that  GM  was  preferable  because 
it  had  a  somewhat  higher  mean  validity.  During  the  formulation  of  the 
interim  ASVAB  8/9/10  composites  the  definitions  of  MM  and  (31  were 
changed  so  that  most  of  the  subtest  content  that  was  in  the  ASVAB  6/7  GM 
was  moved  into  the  ASVAB  8/9/10  MM  composite.  For  this  reason  and 
because  GM  in  ASVAB  6/7  correlates  best  (0.93)  with  MM  in  ASVAB  8/9/10, 
we  recommend  MM  as  the  interim  ASVAB  8/9/10  composite  for  mechanical 
courses. 


TABLE  21 

CORRELATIONS  BETWEEN  USMC  ASVAB  6/7  AND  ASVAB  8/9/10  COMPOSITES 


Correlations3  between  ASVAB  6/7  composite  and : 


ASVAB  6/7 
composite 

Like-named 

ASVAB  8/9/10 
composite 

Highest  correlati 
in  ASVAB  8/9/10 

GM 

.92 

.93  (MM)b 

MM 

.89 

.89  (MM)b 

EL 

.94 

.94  (EL)b 

CL 

.79 

.86  (GT)b 

FA 

.90 

.92  (EL)b 

CO 

.79 

.83  (MM)b 

GT 

.91 

.91  (GT)b 

GCT 

_a 

.90  (GT)b 

aComputed  from  a  stratified  sample  of  2,025  applicants  for  enlistment 
from  all  services. 

'’ASVAB  8/9/10  composite  having  highest  correlation  with  indicated  ASVAB 
6/7  composite. 

cGCT  is  not  computed  for  ASVAB  8/9/10. 


The  EL  composite  in  ASVAB  8/9/10  is  seen  (table  21)  to  correlate 
well  (0.94)*  with  the  EL  composite  in  ASVAB  6/7  and  should  be  suitable 
as  a  selector  for  electronics  courses.  The  correlation  between  the  CL 
composite  in  ASVAB  6/7  and  the  CL  composite  in  ASVAB  8/9/10  is  rather 


*  Because  the  structure  of  the  EL  composite  was  not  changed  In  the 
transition  from  ASVAB  6/7  to  ASVAB  8/9/10,  the  observed  correlation  of 
0.94  may  be  taken  as  a  measure  of  the  reliability  of  the  ASVAB  8/9/10 
composites. 
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low  (0.79).  This  indicates  that  the  validity  of  the  CL  composite  in 
ASVAB  8/9/10  is  likely  to  be  different  (either  better  or  worse)  than  it 
was  in  ASVAB  6/7.  (We  return  to  the  question  of  the  validity  of  CLi 
later.)  The  FA  composite  from  ASVAB  8/9/10  correlated  0.90  with  its 
like-named  composite  in  ASVAB  6/7  and  should  be  a  satisfactory  replace¬ 
ment.  The  CO  composite  in  ASVAB  8/9/10  correlates  only  0.79  with  its 
like-named  composite  in  ASVAB  6/7  and,  hence,  may  produce  somewhat 
different  validity  results.  Because  none  of  the  ASVAB  6/7  composites 
had  particularly  high  validity  for  combat  training,  the  0.79  correlation 
for  CO  composite  is  not  likely  to  be  troublesome.  We  recommend  the  use 
of  the  interim  CO  composite.  The  GCT  composite  from  ASVAB  8/9/10  cor¬ 
relates  0.91  with  the  like-named  composite  in  ASVAB  6/7  and  should  be  a 
suitable  replacement.  The  GCT  composite  is  not  computed  in  ASVAB 
8/9/10.  Because  GCT  in  ASVAB  6/7  correlates  0.90  with  GT  in  ASVAB 
8/9/10  we  recommend  GT  as  an  appropriate  replacement  for  GCT. 

ESTIMATED  VALIDITY  OF  ASVAB  8/9/10 

Most  of  the  tests  used  in  the  ASVAB  8/9/10  composites  were  also 
Included  in  ASVAB  6/7.  Therefore,  we  can  simulate  ASVAB  8/9/10 
composites  in  our  ASVAB  6/7  data  set  and  calculate  estimates  of  their 
validity.  We  have  carried  out  this  calculation  for  three  representative 
courses  with  large  sample  sizes  in  the  mechanical,  electrical,  and 
clerical  areas.  The  formulations  of  the  actual  and  simulated  ASVAB 
8/9/10  composites  are  given  in  table  22. 

Estimated  validity  coefficients  were  calculated  for  the  three 
representative  courses  and  are  shown  in  table  28.  The  estimated 
validities  for  ASVAB  8/9/10  are  as  good  as  or  better  than  they  were  for 
ASVAB  6/7  except  in  the  case  of  the  CL  composite,  which  is  slightly 
lower.  Because  the  validity  of  the  CL  composite  in  ASVAB  6/7  was 
already  somewhat  lower  than  desirable  (table  8)  this  result  is 
disturbing  and  indicates  that  the  formulation  of  the  CL  composites 
should  be  revised  as  soon  as  possible.  A  suggested  formulation  for  CL 
that  would  improve  its  validity  is  given  in  chapter  6. 


TABLE  22 


Course  grouping 
Mechanical  (MM) 

Electrical  (EL) 
Clerical  (CL) 


SIMULATED  ASVAB  8/9/10  COMPOSITES 


ASVAB  8/9/10  composite 
AR  +  AS  +  MC  +  El 

GS  +  AR  +  MK  +  El 
VE  +  NO  +  CS 


Simulated  ASVAB  8/9/10 
_  -  composite  _ 

AR  +  (SI  +  AI)  +  MC  +  El 
2 

GS  +  AR  +  MK  +  El 
WK  +  2(N0)a 


aNO  is  the  test  with  the  highest  correlation  with  CS  (0.64). 


TABLE  23 

ESTIMATED  VALIDITY  OF  ASVAB  8/9/10  COMPOSITES  FOR 
THREE  REPRESENTATIVE  COURSES 

_ Validity3 _ 


Simulated 


Course 

Composite 

ASVAB  6/7 

ASVAB  8/9/10 

Basic  auto  mechanics 

MM 

0.65 

0.71 

Basic  electronics 

EL 

0.61 

0.61 

Administrative  clerk 

CL 

0.53 

0.49 

aCorrected  for  restriction  of  range. 


-38- 


i 


COMPOSITES  FOR  ASVAB  8/9/10 


We  have  seen  that,  except  for  the  change  from  GM  to  MM,  the  like- 
named  composites  recommended  for  ASVAB  6/7  (table  11)  are  appropriate 
for  ASVAB  8/9/10*  This  recommendation  is  summarized  in  table  24.  We 
expect  that  the  validity  of  these  ASVAB  8/9/10  composites  will  be 
similar  to  that  observed  for  the  ASVAB  6/7  composites. 


TABLE  24 

ASVAB  8/9/10  COMPOSITES  RECOMMENDED  FOR  USE  BY  USMC 

Recommended 

Course  content  area  ASVAB  8/9/10  composite 


Mechanical 

MM 

Electrical 

EL 

Clerical 

CL 

Field  Artillery 

FA 

Combat 

CO 

General 

GT 

CHAPTER  5 


COMPOSITE  SCORE  PREREQUISITES  FOR  ASVAB  8/9/10 


In  this  chapter  we  take  the  aptitude  selector  composite  for  each 
course  to  be  that  recommended  in  chapter  4  and  address  the  question  of 
what  should  be  the  minimum  composite  score  for  assignment  to  each  entry- 
level  course.  Clearly,  the  setting  of  minimum  prerequisties  (cut 
scores)  involves  personal  judgment  as  well  as  analysis.  The  resulting 
cut  scores,  therefore,  should  be  viewed  as  reasonably  accurate,  but  not 
precisely  determined  points. 

CORRECT  NORMALIZATION  OF  ASVAB 

As  previously  noted,  the  Assistant  Secretary  of  Defense  (Manpower, 
Reserve  Affairs,  and  Logistics)  determined  in  July  1980  that  the  normal¬ 
ization  of  ASVAB  6/7  had  been  in  error  since  January  1976  [4].  The 
error  was  in  such  a  direction  as  to  inflate  the  ASVAB  scores  of 
recruits.  The  analysis  discussed  in  this  chapter  uses  test  scores  from 
ASVAB  6/7.  However,  these  ASVAB  6/7  scores  have  all  been  adjusted  to 
reflect  the  correct  [5]  normalization  of  ASVAB  6/7.  With  this  adjust¬ 
ment,  both  ASVAB  6/7  and  ASVAB  8/9/10  scores  are  scaled  to  the  same 
traditional  reference  population  and  may  be  viewed  as  equivalent.  Cut 
scores  that  are  found  to  be  appropriate  from  ASVAB  6/7  data  should  be 
appropriate  for  use  with  ASVAB  8/9/10. 

Because  ASVAB  8/9/10  is  correctly  normed,  recruits  at  a  given  score 
level  on  ASVAB  8/9/10  will  perform  better  than  recruits  at  that  same 
score  level  on  the  incorrectly  normed  ASVAB  6/7.  Therefore,  expec¬ 
tations  of  future  recruit  performance  in  training  schools  should  be 
adjusted  upward  even  if  current  nominal  prerequisite  levels  remain 
unchanged.  Figure  2  illustrates  observed  failure  rates  in  the  Basic 
Electronics  Course  as  a  function  of  EL  composite  scores  calculated  using 
both  the  incorrect  and  the  correct  norms.  The  observed  failure  rate  at 
each  score  level  is  seen  to  be  lower  for  scores  calculated  on  the  basis 
of  correct  norms. 

The  error  in  the  original  norming  of  ASVAB  6/7  did  have  one  posi¬ 
tive  effect.  It  afforded  us  the  opportunity  to  observe  the  performance 
of  low  aptitude  recruits  who,  had  the  normalization  been  correct,  would 
not  have  qualified  for  enlistment.  These  low  aptitude  recruits  are 
Included  in  the  data  used  in  this  analysis. 

RECENT  CHANGES  IN  PREREQUISITES 

Prerequisites  used  for  Marine  Corps  training  courses  have  tradi¬ 
tionally  been  stable.  They  have,  however,  undergone  two  major  changes 
since  1975.  These  changes  were  due  to  the  misnorming  of  ASVAB  6/7 


Percentage  of  recruits  failing 


and  Co  efforts  to  compensate  for  the  underprediction,  by  ASVAB,  of  high 
school  graduate  performance. 


The  use  of  incorrect  norms  for  ASVAB  6/7  from  January  1976  through 
September  1980  Inflated  the  ASVAB  scores  of  recruits.  This  inflation  of 
ASVAB  scores  effectively  lowered  real  prerequisites  from  4  to  10  com¬ 
posite  score  points*  below  previous  levels  [10]. 

An  analysis  conducted  in  1977  [11]  showed  that  high  school 
graduates  outperform  non-high  school  graduates  with  identical  aptitude 
scores.  In  1978  the  Marine  Corps,  following  the  recommendations  of 
[11],  adjusted  training  prerequisites  to  compensate  for  this  difference 
in  performance.  This  adjustment  consisted  of  lowering  prerequisites  for 
high  school  graduates  by  10  composite  score  points  while  maintaining 
those  of  non-high  school  graduates  at  their  previous  level. 

The  combined  effect  of  these  two  changes  was  to  lower  prerequisites 
by  as  much  as  20  composite  points  for  high  school  graduates  and  as  much 
as  10  composite  score  points  for  non-high  school  graduates.  The  decre¬ 
ment  in  prerequisites  due  to  misnormed  tests  was  removed  in  October  1980 
with  the  introduction  of  the  correctly  normed  ASVAB  d/9/10 
[12  and  13].  However,  the  decrement  due  to  lower  standards  for  high 
school  graduates  is  still  in  effect. 

COURSE  FAILURE  RATES 

The  primary  goal  in  setting  test  score  prerequisites  for  training 
courses  is  to  ensure  that  recruits  assigned  to  these  courses  have  a 
reasonable  probability  of  successfully  completing  the  course.**  The 
maximum  acceptable  failure  rate  has,  to  the  best  of  our  knowledge,  never 
been  analytically  determined;  but  is  generally  considered  to  be  about 
10  percent. 

The  failure  rates  observed  for  entry  level  courses  attended  by 
Marine  Corps  recruits  in  FY  1980  are  summarized  In  table  25.  We  see, 
for  example,  that  32  percent  of  the  courses  had  failure  rates  of  less 
than  5  percent.  Table  25  also  shows  that  48  percent  of  all  courses  had 
failure  rates  of  10  percent  or  more.  To  the  extent  that  a  10  percent 
failure  rate  is  a  reasonable  goal,  it  appears  that  either  many  current 
prerequisites  are  too  low  or  that  the  course  content  is  too  hard. 


*  ASVAB  composites  used  by  the  Marine  Corps  are  scaled  to  have 
approximately  a  mean  of  100  and  a  standard  deviation  of  20  in  the 
traditional  reference  population. 

**  Performance  on  the  job  is  a  separate  issue,  but  it  has  generally  been 
assumed  that  recruits  who  successfully  complete  the  training  courses  are 
qualified  to  perform  their  military  job. 
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TABLE  25 


DISTRIBUTION  OF  FY  1980  COURSE  FAILURE  RATES 

Failure  rate  interval  Percentage®  of  all 

(percentage  falling)  _ courses _ 


0.0  -  4.9 

32 

5.0  -  9.9 

20 

10.0  -  14.9 

16 

15.0  -  19.9 

9 

20.0  -  24.9 

12 

25.0  -  29.9 

5 

_>  30.0 

6 

100 


Source:  Headquarters  Marine  Corps  Training 
Division  [14]. 

Percentage  of  all  86  courses  for  which  data 
were  available. 


In  this  report  we  assume  that  course  content  and  instructional 
methodology  are  not  going  to  change  radically  in  the  near  future.  We 
therefore  have  attempted  to  determine  prerequisites  that  will  be  appro¬ 
priate  under  the  present  circumstances. 

RECRUIT  DISTRIBUTION  MODEL 

The  Recruit  Distribution  Model  (RDM)  is  the  mechanism  whereby 
recruits  are  assigned  to  specific  training  courses  that  best  match  their 
aptitudes  as  measured  by  ASVAB  scores,  the  needs  of  the  Marine  Corps, 
and  previously  guaranteed  training  commitments.  These  considerations 
are  brought  together  in  the  RDM  dictionary.  For  illustration  the  RDM 
dictionary  listing  for  the  Baslr  Electronics  Course  (BEC)  is  reproduced 
in  table  26.  Note  from  table  26  that  there  are  two  levels  of  prerequi¬ 
sites  shown  for  BEC.  The  "mandatory”  level  requires  high  school 
algebra,  an  EL  score  of  100,  a  GT  score  of  110,  high  school  diploma, 
security  clearance,  and  color  vision.  The  mandatory  prerequisites 
represent  the  minimum  acceptable  level.  The  preferred  qualifications 
for  this  course  are  expressed  by  the  "desirable"  level,  which  Includes 
all  the  mandatory  prerequisites  plus  an  EL  score  of  110  and  a  4-year 
enlistment.  Once  the  REM  determines  an  allocation  of  recruits  that  will 
fill  all  essential  school  seats  at  the  mandatory  level,  recruits  are 
shifted  among  various  assignments  for  which  they  qualify  to  maximize  the 
resulting  mean  value  of  the  selector  area  aptitude  (AA  score)  that  has 


-43- 


/ 


been  designated  as  the  best  predictor  of  success  In  each  course.  In  the 
case  of  BEC,  the  selector  area  aptitude  is  GT  (see  table  26). 


TABLE  26 

ILLUSTRATION  OF  RECRUIT  DISTRIBUTION  MODEL  DICTIONARY  FOR 
BASIC  ELECTRONICS  COURSE 


Prerequisites  (for  high  school  graduates  only)3 


Mandatory 


Desirable 


Selector  area 
aptitude 
composite 
(AA  score  ) 


EL  100 
GT  110 

High  school  algebra 
High  school  graduate 
Security  clearance 
Color  vision 


EL  110 
GT  110 

High  school  algebra 
High  school  graduate 
Security  clearance 
Color  vision 
4— year  enlistment 


GTb 


aNon-high  school  graduates  are  not  assigned  to  this  particular  course. 
However,  if  they  were,  their  test  score  prerequisites  would  be  10  points 
higher  than  those  shown  in  this  table. 

bOnce  a  pool  of  recruits  who  meet  the  minimum  prerequisites  for  each 
course  has  been  identified  the  recruits  are  shifted  among  various 
possible  assignments  for  which  they  are  qualified  in  an  effort  to  maxi¬ 
mize  the  selector  area  aptitude  composite  designated  for  each  course. 


There  are  some  courses  for  which  the  selector  area  aptitude  compos¬ 
ite  (table  26)  has  not  been  chosen  to  be  the  same  composite  as  the  one 
used  to  define  the  mandatory  prerequisite  level.  This  practice  will 
result  in  nonoptlmal  recruit  classification  and  should  be  discontinued. 

DECISION  RULES  FOR  PREREQUISITE  SELECTION 

Performance  (both  training  and  job  performance)  tend  to  be  smoothly 
varying  functions  of  aptitude  test  scores.  For  this  reason  it  is 
generally  difficult  (perhaps  impossible)  to  determine  a  point  on  an 
aptitude  test  such  that  most  individuals  above  that  point  will  subse¬ 
quently  be  successful  and  most  individuals  below  that  point  will  prove 
to  be  unsuccessful.  It  is  particularly  difficult  in  the  present  case, 
because  detailed  information  on  individual  performance  is  not  available 
for  all  training  courses.  For  some  other  courses  the  training  perform¬ 
ance  criteria  are  suspect. 


The  setting  of  prerequisites  is  further  complicated  by  reactions  to 
the  two  inadvertent  lowerings  of  prerequisites  discussed  earlier  in  this 
chapter.  Some  training  schools  viewed  trainee  quality  unsatisfactory 
and  requested  relief  in  the  form  of  increased  prerequisites.  Some 
schools  were  granted  relief  and  others  were  not. 

In  view  of  these  uncertainties  we  adopted  a  conservative  approach 
to  setting  prerequisites.  We  took  as  a  starting  point  the  prerequisite 
levels  in  use  during  the  generally  stable  period  prior  to  1976.  We  then 
reviewed  these  prerequisites  and  made  changes  in  their  level  only  if 
available  data  provided  strong  evidence  for  change  Our  guidelines  may 
be  summarized  as  follows: 

•  Use  traditional  (pre-1976)  prerequisite  levels  unless 
there  is  strong  evidence  to  the  contrary 

•  For  courses  in  which  change  is  dictated,  set  prerequisites 
so  that  no  more  than: 

-  10  to  20  percent  of  recruits  in  the  lowest  composite 
interval  will  fall 

-  5  to  10  percent  of  the  class  will  fail. 

INFORMATION  SOURCES 

The  information  sources  used  to  determine  prerequisites  are  as 
follows: 

•  Traditional  (pre-1976)  prerequisite  levels  [15] 

•  Pass/fail  percentages  by  composite  score  interval  for  46 
courses  during  CY  1977-1978 

•  Pass/fail  percentages  for  86  entry  level  courses  during 
FY  1980  [14] 

•  Course  content  specified  in  USMC  Formal  Schools  Catalog 
[16] 

•  Job  requirements  specified  in  USMC  Military  Occupational 
Specialities  (MOS)  Manual  [17]. 

SELECTION  OF  PREREQUISITES  SCORE  LEVELS 

We  will  illustrate  our  selection  of  prerequisite  score  levels  by 
describing  the  process  for  five  representative  courses.  These  courses 
are  Basic  Supply  Stock  Clerk,  Basic  Electronics,  Basic  Helicopter  Main¬ 
tenance,  Airborne  Radio  Operator,  and  Freight  Transportation  Clerk. 
Prerequisites  for  other  courses  were  determined  in  a  similar  manner. 

Data  used  in  the  selection  procedure  are  tabulated  in  appendix  G. 


Basic  Supply  Stock  Clerk 

Figure  3  shows  failure  rates  by  score  interval  for  Basic  Supply 
Stock  Clerk  and  two  other  courses.  The  graph  for  Basic  Supply  Stock 
Clerk  shows  that  the  failure  rate  of  recruits  decreases  as  the  composite 
score  increases.  The  pre-1976  prerequisite  level  for  this  course  was 
100  and  the  current  level  is  110.*  Figure  3  shows  that  recruits  at  a 
composite  score  of  110  experience  a  failure  rate  of  about  19  percent. 
Figure  4  shows  the  failure  rate  to  be  expected  for  the  entire  course  if 
the  recruit  input  were  restricted  to  those  at  or  above  the  indicated 
composite  score.  Reference  to  figure  4  shows  that  a  minimum  composite 
score  of  110  should  produce  a  class  failure  rate  of  about  10  percent. 
Because  these  failure  rates  are  within  our  guidelines  we  recommend  a 
prerequisite  level  of  110  for  this  course. 

Basic  Electronics 


Recruit  failure  rates  by  composite  score  interval  and  class  failure 
rates  by  minimum  composite  score  are  shown  for  the  Basic  Electronics 
Course  in  figures  3  and  4.  Both  the  current  and  pre-1976  prerequisite 
levels  for  this  course  are  110.  We  see  from  figure  3  that  about  47 
percent  of  recruits  at  this  level  are  expected  to  fail  the  course.  We 
view  this  as  too  high  and  recommend  a  prerequisite  of  115  for  this 
course.  Figures  3  and  4  show  that  about  33  percent  of  the  recruits  at 
this  level  will  fail  and  that  about  16  percent  of  the  entire  class  will 
fail.  We  note  that  these  projected  failure  rates  are  higher  than  our 
guidelines.  To  meet  our  guidelines  a  prerequisite  level  of  120  would  be 
required.  If  recruit  supply  were  not  a  consideration  then  120  would  be 
an  appropriate  level.  However,  given  the  present  supply  situation  we 
are  reluctant  to  raise  the  prerequisites  for  this  course  to  such  a  level 
as  to  absorb  a  larger  percentage  of  the  high  aptitude  recruits.  At  this 
time,  we  view  115  as  an  appropriate  prerequisite  level  for  this  course. 

Basic  Helicopter  Maintenance 

Vfe  see  from  figures  3  and  4  that  the  failure  rate  for  this  course 
seems  to  be  Independent  of  composite  score.  Figure  5  shows  that  the 
failure  rate  on  the  first  attempt  at  the  course  does  show  the  expected 
dependence  on  composite  score.  The  figure  also  shows  that  it  is 
possible  for  most  of  the  lowest  aptitude  recruits  to  pass  the  course 
after  repeated  attempts.  Whether  those  who  pass  only  after  repeated 
attempts  perform  well  on  the  job  after  graduating  is  an  open  question. 
The  pre-1976  prerequisite  level  for  this  course  was  100  and  the  current 
level  is  85.  From  references  16  and  17  we  conclude  that  the  course 
content  is  substantive  and  that  the  course  graduates  are  expected 


*  All  prerequisite  levels  discussed  in  this  chapter  will  be  those 
appropriate  for  high  school  graduates.  Current  prerequisite  levels  for 
non-high  school  graduates  are  higher  by  10  composite  score  points. 
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Percentage  of  recruits  failing  by  score  interval 


90 


70  80  90  100  110  120  130 

Composite  score 


FIG.  3:  ILLUSTRATION  OF  FAILURE  RATES  BY  COMPOSITE 
SCORE  INTERVAL 


Percentage  of  recruits  failing  by  Cumulative  percentage  of  failures  for 

score  interval  2  indicated  cut  score 


i.  4:  ILLUSTRATION  OF  CLASS  FAILURE  RATE  BY  COMPOSITE  CUT  SCORE 


FIG.  5:  ILLUSTRATION  OF  EFFECT  OF  RECYCLING  ON  FAILURE  RATE  IN 
BASIC  HELICOPTER  MAINTENANCE  COURSE 


to  perform  critical  work.  We  therefore  conclude  that  there  is  no  reason 
to  change  the  pre-1976  prerequisite  level  of  100. 

Airborne  Radio  Operator 

Failure  rates  by  composite  interval  are  not  available  for  this 
course.  The  only  data  available  consists  of  a  single  failure  rate  for 

all  recruits  who  entered  the  course  in  FY  1980.  That  failure  rate 

(shown  for  this  and  85  other  courses  in  appendix  G)  was  24  percent.  The 
present  prerequisite  for  this  course  is  100  while  the  pre-1976  level  was 
110.  We  consider  the  24  percent  failure  rate  to  be  excessive  and  recom¬ 
mend  a  return  to  the  pre-1976  level  of  110. 

Freight  Operations  Clerk 

There  are  no  failure  rate  data  available  for  this  on-the-job 
training  course.  The  present  prerequisite  level  is  80  as  was  the 

pre-1976  level.  From  a  review  of  the  job  requirements  as  set  forth  in 

[17]  we  conclude  that  this  is  an  appropriate  prerequisite  for  this 
course. 

RECOMMENDED  PREREQUISITE  LEVELS 

Prerequisites  for  all  entry  level  courses  were  examined  as  illus¬ 
trated  by  the  examples  shown  in  the  previous  section.  The  courses  and 
their  RDM  assignment  symbol,  pre-1976  prerequisite  level,  current  pre¬ 
requisites,  and  our  recommended  prerequisites  are  shown  in  table  27. 

Our  recommendations  shown  in  table  27  apply  to  high  school  diploma 
graduates  only.  We  recommend  prerequisites  10  composite  points  higher 
for  non-high  school  graduates. 

Validity  data  on  ASVAB  8/9/10  using  both  training  and  job  perfor¬ 
mance  measures  are  likely  to  be  available  within  a  few  years.  At  that 
time  it  would  be  reasonable  to  update  the  prerequisites  shown  in 
table  27 . 

COMPARISON  OF  TEST  LEVELS  IN  MILITARY  AND  CIVILIAN  JOBS 

During  World  War  II  (WWII)  a  large  and  presumably  representative 
group  of  men  entered  military  service.  These  men  came  from  a  wide 
variety  of  civilian  occupations.  Reference  [18]  reports  on  a  study  of 
the  relationship  between  civilian  occupation  and  test  scores  on  the  Army 
General  Classification  Test  (AGCT).  The  data  used  for  the  study  is 
based  on  81,553  white  army  enlisted  men  from  227  different  civilian 
occupations. 
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SUGGESTED  APTITUDE  TEST  PREREQUISITES  FOR  ASVAB  8/9/10 


TABLE  27  (Cont'd) 


TABLE  27  (Cont'd) 


TABLE  27  (Cont’d) 


TABLE  27  (Cont'd) 


TABLE  27  (Cont'd) 


TABLE  27  (Cont'd) 


Because  the  military  services  have  referenced  all  subsequent  test 
scores,  either  directly  or  indirectly,  back  to  the  AGCT  we  may  view 
scores  on  current  versions  of  ASVAB  as  approximately  equivalent  to 
scores  on  the  AGCT.  For  this  reason  it  is  of  Interest  to  compare  the 
prerequisite  levels  we  recommend  with  the  test  scores  achieved  by 
individuals  in  comparable  civilian  occupations  during  WWII.  We  show 
this  comparison  for  a  representative  sample  of  courses  in  table  28.  The 
comparison  shows  that  the  minimun  test  scores  recommended  by  us  agree 
rather  well  with  those  made  by  the  25th  percentile  of  individuals  in 
comparable  civilian  jobs  during  WWII. 


TABLE  28 

COMPARISON  OF  APTITUDE  TEST  LEVELS  FOR  COMPARABLE 
MILITARY  AND  CIVILIAN  JOBS 


Military 


Civilian® 


Test  score  of  25th 
percentile  of 
white  WWII  en- 


Course 

Mandatory  pre¬ 
requisite  level 

Comparable 

civilian 

job 

listed  men 
from  Indicated 
civilian  job 

Basic  electronics 

115 

Radio  repairman 

108 

Basic  supply  stock  clerk  110 

Supply  stock 

clerk 

107 

Administrative  clerk 

100 

Clerk-typist 

110 

Machinists  mate 

100 

Machinist 

99 

Military  police 

100 

Policeman 

96 

Basic  plumber 

90 

Plumber 

87 

Basic  automotive 

Automotive 

mechanic 

90 

mechanic 

89 

Light  truck 

Light  vehicle 

driver 

80 

operator 

80 

®From  [18J. 


We  assume  that  the  ability  to  perform  a  certain  job  has  a  strong 
bearing  on  whether  an  individual  holds  that  job  in  the  civilian 
economy.  For  this  reason  we  view  the  generally  similar  test  score 
levels  shown  for  comparable  military  and  civilian  jobs  as  an  external 
•  Indication  that  our  recommended  prerequisites  are  reasonable. 


A 
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CHAPTER  6 


IMPROVED  COMPOSITES  FOR  ASVAB  8/9/10 


BACKGROUND 

The  ASVAB  8/9/10  composites  discussed  in  chapter  4  represent 
Interim  solutions  that,  except  for  CL,  are  likely  to  have  approximately 
the  same  validity  as  did  the  comparable  ASVAB  6/7  composites  used  from 
1  January  1976  through  30  September  1980.  In  this  chapter  we  discuss 
possible  Improvements  that  might  be  made  In  future  formulations  of  these 
composites.  We  also  discuss  an  improved  formulation  of  the  AFQT. 

In  principle,  the  construction  of  Improved  composites  should  be 
very  simple.  One  might  conduct  (as  in  table  6)  a  stepwise  regression  of 
individual  ASVAB  test  scores  against  a  performance  criterion  such  as 
FCG.  Having  found  the  "best"  set  of  test  scores  for  predicting  FOG  in 
each  course,  one  could  simply  use  that  combination  as  the  composite  for 
that  course — right?  Wrong! 

If  one  proceeds  in  this  fashion  the  result  will  generally  be  a 
different  composite  for  each  course  (a  minor  inconvenience).  Of  more 
concern  is  that  many  of  the  composites  will  be  "wrong.”  They  will  be 
wrong  in  the  sense  that  they  are  not  stable  and,  hence,  not  optimum.  In 
our  discussion  of  the  global  versus  course-specific  approach  to  compos¬ 
ite  selection  (chapter  3)  we  set  forth  the  reasons  for  this  situation. 
Statistical  uncertainties,  residual  range  restriction  uncertainties,  and 
large  test  intercorrelations  will  produce  unstable  regression  results 
that  will  lead  to  frequent  and  counter-productive  changes  in  composite 
definitions.  In  this  chapter  we  formulate  composites  by  a  method  that 
minimizes  these  uncertainties . 

Two  Important  features  of  composite  design  are  differentiation  and 
validity.  To  some  degree  these  two  design  criteria  are  related  and  it 
appears  to  be  difficult  to  simultaneously  achieve  maximum  differen¬ 
tiation  and  maximum  validity.  Reference  (2]  found  that  ASVAB  6/7  con¬ 
tains  four  common  factors  (math,  verbal,  shop,  and  attitude).  Reference 
[3]  found  that  it  was  possible  to  construct  composites  based  on  combi¬ 
nations  of  three  of  the  pure  factors  (math,  verbal,  and  shop)  that  would 
have  validity  as  high  as  present  composites  but  much  better  differen¬ 
tiation.  Marine  Corps  testing  personnel  viewed  the  calculation  of  these 
composites  as  too  complex  for  operational  use.  In  this  chapter  we  draw 
on  the  factor  analysis  approach,  without  the  complication  of  calculating 
pure  factors,  to  formulate  a  set  of  composites  for  ASVAB  8/9/10  that 
should  combine  high  levels  of  differentiation  with  high  levels  of 
validity. 


FACTOR  ANALYSIS  OF  ASVAB  6/7 


ASVAB  6/7  consists  of  16  separate  tests  (table  1).  Taken  at  face 
value,  each  of  these  tests  measures  a  different  attribute.  In  fact, 
many  of  these  tests  are  highly  correlated  and  may  really  measure  the 
same  or  very  similar  attributes.  To  reduce  the  apparent  complexity  of 
the  separate  tests  and  gain  some  insight  into  the  attributes  actually 
measured  by  the  battery  we  conducted  a  standard  factor  analysis.  The 
details  of  the  analysis  are  given  in  appendix  H. 

The  tests  in  the  battery  are  assumed  to  consist  of  factors  shared 
by  that  test  and  one  or  more  other  tests  (common  factors)  and  a  factor 
unique  to  that  test  (specific  factor).  The  contribution  of  the  factors 
is  frequently  described  in  terms  of  the  percentage  of  the  variance  in 
scores  of  each  test  that  is  due  to  each  common  factor,  that  which  is 
unique  to  each  test  (specificity),  and  that  due  to  measurement  error. 

The  analysis  described  in  appendix  H  found  that  ASVAB  6/7  could  be 
described  In  terms  of  four  common  factors,  which  we  denote  as  "verbal," 
"math,"  "shop,"  and  "attitude."  The  factor  content  of  the  individual 
tests  is  illustrated  in  figure  6.  It  is  seen  that  VK,  GS,  and  GI  are 
dominated  by  the  verbal  factor.  These  tests  also  display  some  specifi¬ 
city  and,  of  course,  measurement  error.  The  AR  and  MC  tests  contain 
significant  amounts  of  the  math  factor  as  well  as  the  verbal  factor. 

The  only  common  factor  in  the  NO  test  is  the  math  factor.  The  AI,  SI, 
El,  and  MC  each  contain  shop  and  verbal  factors.  The  remaining  tests 
were  not  included  in  ASVAB  8/9/10  and,  hence,  are  not  of  concern  in  this 
discussion.  A  knowledge  of  the  factor  content  of  the  tests  gives  us  a 
basis  for  grouping  the  tests  into  three  types:  those  that  are  primarily 
verbal,  those  that  contain  significant  amounts  of  math,  and  those  that 
contain  significant  amounts  of  shop.  By  grouping  the  tests  in  this 
manner  we  can  analyze  group  behavior  and  thereby  lessen  the  effects  of 
the  uncertainty  in  the  regression  approach  to  constructing  better 
composites . 

FORMUIATION  OF  EXPERIMENTAL  ASVAB  8/9/10  COMPOSITES 

We  use  validity  data  from  all  33  FOG  courses  with  100  or  more 
cases.  The  first  step  in  our  procedure  is  stepwise  regression*  of 
performance  (FCG)  as  a  function  of  those  ASVAB  6/7  tests  that  were 
retained  in  ASVAB  8/9/10.  The  results  for  the  best  combinations  of 
three  tests  are  tabulated  in  table  29.  For  example,  the  three  most 
important  tests  for  predicting  success  in  the  Basic  Supply  Stock  Clerk 
course  were  MK,  WK,  and  AR.  Together  they  had  a  multiple  cor”“lation 
with  FCG  of  0.60.  Groups  of  three  were  chosen  because  the  multiple 


*  Only  variables  entering  the  regression  with  a  positive  sign  and  having 
a  significance  level  of  at  least  0.05  were  allowed. 


FACTOR  CONTENT  OF  INDIVIDUAL  ASVAB  6/7  TESTS 


r 


*  TABLE  29 

BEST  COMBINATION  OF  ASVAB  TESTS®  FOR 
PREDICTING  SUCCESS  IN  TRAINING 


Multiple  corrAletlonc 
for  Indicated  number 
_ of  fate _ 


Course 

Sue  co.61n.tlon11  of  cut. 

_1_ 

_2 

_3 

_4 

Basic  supply  stock  clerk 

m,  UK,  AR 

36 

59 

60 

60 

Personal  financial  records  clerk 

MX,  AR,  NO 

62 

67 

68 

68 

Basic  automotive  mechanic 

AX,  MI,  EX 

61 

68 

71 

72 

Advanced  automotive  mechanic 

MC,  AI,  AR 

63 

69 

73 

74 

Basic  baker 

MX,  EX,  AR 

55 

60 

62 

62 

Basic  food  service 

GS,  AR,  MR 

47 

S3 

54 

55 

Basic  combat  engineer 

MC,  AR,  El 

57 

64 

67 

68 

Basic  electrician 

KC,  UK,  AI 

44 

49 

51 

54 

Electrical  equipment  repairman 

*,  UK 

38 

41 

41 

41 

Basic  engineer  equipment  mechanic 

MC,  AI,  MR 

53 

60 

64 

64 

Administrative  clerk 

MR,  UR,  NO 

54 

59 

60 

62 

Personnel  clerk 

MR,  NO,  UR 

58 

61 

63 

65 

Unit  diary  clerk 

MR,  UR 

59 

64 

64 

64 

Sea  duty  indoctrination 

UR,  NO,  GS 

46 

52 

53 

56 

Basic  electronics 

MR,  El,  GS 

60 

65 

66 

67 

Radio  fundamentals 

GS,  NO,  SI 

40 

45 

47 

48 

Field  radio  operator 

MC,  EX,  UR 

48 

53 

55 

55 

Communications  center  man 

MR,  UR,  NO 

54 

60 

63 

64 

Infantry  training 

GS,  MI,  MC 

30 

33 

34 

35 

Tracked  vehicle  repair 

GS,  AR,  UK 

60 

67 

68 

70 

Basic  helicopter 

MC,  MI,  AX 

51 

58 

63 

64 

Aviation  structural  mechanic  (safety  equipment) 

MR,  EX,  UK 

50 

58 

60 

61 

Aviation  structural  mechanic  (hydraulics) 

MC,  GS,  AR 

58 

64 

66 

68 

Aviation  structural  mechanic  (structural) 

GS,  MR,  SI 

55 

61 

63 

64 

Aviation  acdnsace 

MR,  MC,  GS 

53 

59 

61 

61 

Aviation  crash  crew 

AR,  El,  AX 

41 

48 

45 

49 

Avionics  repair 

AR,  El,  MC 

57 

67 

69 

70 

Aviation  operations  (clerical) 

MR,  AR,  NO 

46 

48 

50 

50 

Aviation  maintenance  administration 

MR,  AR,  GS 

56 

59 

60 

61 

Aviation  supply  (mechanical) 

MR,  WK,  NO 

58 

61 

63 

64 

Small  arms  repair 

MC,  AR,  SI 

38 

43 

46 

48 

Ammunition  storage 

GS,  MX,  SI 

55 

60 

63 

64 

Basic  cannoneer 

MR,  GS 

49 

22 

55 

55 

Mean 

52 

57 

59 

60 

*0f  Chose  ASVAB  6/7  tests  thee  were  retained  In  ASVAB  8/9/10. 

bIn  order  eneered  into  stepwise  regression.  Only  variables  with  positive  signs  and  at  least  0.05 
significance  level  were  allowed. 

Multiplied  by  100  and  corrected  for  restriction  of  range.  Some  regressions  terminated  before  four 
tests  entered.  In  these  cases  the  multiple  correlation  from  the  terminal  step  was  assumed  to  hold  for 
all  remaining  steps. 


f 
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correlation  generally  did  not  increase  significantly  with  the  addition 
of  more  tests. 

The  results  of  table  29  are  grouped  by  test  type  and  course  type  in 
table  30.  The  test  type  groupings  were  determined  by  the  factor 
analysis  discussed  earlier.  For  example,  for  six  courses  in  the  mechan¬ 
ical  grouping  the  MC  test  was  one  of  the  three  most  important  predictors 
of  FCG .  Because  many  of  the  tests  are  strongly  correlated  we  cannot, 
for  example,  take  at  face  value  that  six  mechanical  courses  should  use 
MC  as  a  predictor,  five  should  use  AI,  two  should  use  SI,  and  four 
should  use  El.  Ve  can,  however,  be  confident  that  if  MC  enters  the 
stepwise  regression  then  some  shop-type  test  is  needed  as  a  predictor 
for  that  course.  In  table  31  we  show  the  same  data  with  entries  for 
tests  of  similar  content  further  collapsed  into  broad  test-type  cate¬ 
gories.  Me  see  that  different  test  types  are  important  for  the  mechan¬ 
ical,  electrical,  and  clerical  course  groupings.  The  data  for  the  three 
remaining  course  groupings  is  so  sparse  that  they  probably  cannot  be 
treated  separately. 

Mechanical  courses  In  table  31  are  seen  to  require  heavy  concen¬ 
trations  of  tests  with  dominant  shop  and  math  factors.  The  electrical 
courses  seem  to  require  more  balance  and  need  tests  of  verbal,  math,  and 
shop  content.  Clerical  courses  need  heavy  concentrations  of  math  and 
some  verbal  content.  Taken  as  a  whole,  the  three  remaining  course 
groupings  (field  artillery,  combat,  and  general)  require  approximately 
equal  amounts  of  math  and  verbal  content.  These  three  course  groupings 
may  be  reasonably  described  as  ‘‘general.” 

Summing  over  all  course  groupings  we  get  an  approximation  to  the 
overall  requirements  for  success  in  military  training.  The  overall 
requirement  seems  to  be  about  two  parts  math,  one  part  verbal,  and  one 
part  shop.  This  requirement  should  define  the  AFQT. 

In  table  32  we  show  our  proposal  for  meeting  the  requirements 
summarized  in  table  31.  Our  system  would  consist  of  four  aptitude  area 
composites  (MM,  EL,  CL,  and  GT)  plus  an  AFQT  to  measure  general  train- 
ability.  The  tests  we  selected  for  each  composite  were  chosen  based  on 
common  factor  content,  presumed  unique  test  content,  and  the  avoidance 
of  unnecessarily  high  composite  intercorrelations. 

In  our  view  the  aptitude  composite  and  AFQT  system  proposed  in 
table  32  offers  improved  differentiation,  better  balance,  and  equal  or 
better  validity  than  the  present  system.  Particular  improvement  is 
likely  to  be  seen  in  the  CL  composite  because  the  available  evidence 
suggests  that  the  present  CL  is  deficient  in  math  content.  The  redefi¬ 
nition  of  the  AFQT  to  include  a  shop  component  (MC)  is  clearly  reason¬ 
able  given  its  role  as  a  measure  of  general  trainability .  This  redefi¬ 
nition  follows  the  tradition  of  a  shop  component  in  previous  versions  of 
AFQT  and  in  service-specific  test  instruments  such  as  the  Navy  Basic 
Test  Battery  ( BTB) . 
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TABLE  32 


CONTENT  OF  EXPERIMENTAL  ASVAB  8/9/10  COMPOSITES 


Course  grouping  (selector  composite) 


Test  type 

Mechanical 

(MM)a 

Electrical 

(EL)b 

Clerical 

(CL)c 

General 

(GT)d 

Total 

(AFQT)' 

Verbal 

GS 

VE 

VE 

VE 

Math 

AR 

MK 

MK 

AR 

AR 

NO 

NO 

Shop 

MC 

El 

MC 

AS 

Miscellaneous 


CS 


fm  *  AR  +  MC  +  AS  . 

bEL  -  GS  +  MC  +  El  . 

<"CL  »  VE  +  MC  +  NO  +  CS  . 

dGT  -  VE  +  AR  . 

eA  FQT  -  VE  +  AR  +  NO  +  MC  . 


We  view  the  set  of  composites  shown  in  table  32  as  experimental 
composites.  We  have  a  high  degree  of  confidence  in  the  use  of  the  MM, 
F.L,  and  CL  in  this  table  for  mechanical,  electrical,  and  clerical 
courses,  respectively.  We  are  also  confident  of  our  formulation  of 
AFQT.  Our  uncertainty,  and  the  reason  for  referring  to  these  composites 
as  experimental,  lies  in  the  use  of  the  GT  for  courses  such  as  infantry 
training  and  tank  crew,  which  by  default  must  fall  in  the  general  cate¬ 
gory.  Currently  available  criterion  measures  for  these  courses  are 
marginal;  hence,  we  recommend  examination  of  additional  validity  data — 
including  job  performance  measures,  before  a  decision  is  made  on  the  use 
of  the  complete  set  of  composites  In  table  32. 

EVALUATION  OF  EXPERIMENTAL  COMPOSITES 

It  is  possible  to  evaluate  some  aspects  of  some  of  the  experimental 
composites  using  existing  data  to  simulate*  the  composites. 


*  The  experimental  composites  were  simulated  from  ASVAB  6/7  data  as: 
MM  -  AR  +  MC  +  (AI  +  SI)/2 
EL  -  GS  +  MC  +  El 
CL  «  WK  +  MK  +  NO 
GT  «  WK  +  AR  . 
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The  intercorrelations  of  the  experimental  ASVAB  8/9/10  composites 
(table  33)  are  seen  to  be  smaller  than  those  for  the  Interim  ASVAB 
8/9/10  composites  (table  34). 


TABLE  33 

INTERCORRELATIONS3 *b»c  OF  EXPERIMENTAL  ASVAB  8/9/10  COMPOSITES 


MM 

EL 

CL 

GT 

MM 

— 

89 

80 

90 

EL 

89 

— 

86 

91 

CL 

80 

86 

— 

89 

GT 

90 

91 

89 

— 

aFrom  a  stratified  sample  of  2,025  applicants  from  all  services. 
bMean  intercorrelation  of  87.5. 

CA11  coefficients  are  multiplied  by  100. 


TABLE  34 

INTERCORRELATION3 »b»c  MATRIX  FOR  INTERIM  ASVAB  8/9/10  COMPOSITES 


MM 

EL 

CL 

GT 

FA 

CO 

GM 

MM 

— 

94 

76 

90 

96 

90 

96 

EL 

94 

— 

81 

94 

94 

88 

97 

CL 

76 

81 

— 

85 

82 

91 

78 

GT 

90 

94 

85 

— 

97 

91 

90 

FA 

96 

94 

82 

97 

— 

95 

95 

CO 

90 

88 

91 

91 

95 

— 

91 

GM 

96 

97 

78 

90 

95 

91 

— 

Correlation  coefficients  were  computed  from  a  stratified  sample  of 
2,025  applicants  for  enlistment  from  all  services. 
hMean  intercorrelation  is  90.0. 

CA11  coefficients  are  multiplied  by  100. 


The  validity  of  the  experimental  ASVAB  8/9/10  composites  can  be 
estimated  using  the  simulation  procedure.  The  resulting  validity  coef¬ 
ficients  are  shown  in  table  35.  The  mean  validity  of  the  experimental 
composites  is  higher  than  that  of  either  the  ASVAB  6/7  composites  or  the 
interim  ASVAB  8/9/10  composites.  Particular  improvement  is  seen  in  the 


validity  of  the  experimental  CL  composite.  We  believe  this  improvement 
is  sufficiently  large  that  we  recommend  adopting  the  experimental  CL 
composite  for  operational  use  as  soon  as  possible. 


TABLE  35 


COMPARISON®  OF  VALIDITIES  FROM  VARIOUS  COMPOSITE  FORMUIATIONS 


Course 

Composite 

ASVAB  6/7 

Simulated'1 

interim 

ASVAB 

8/9/10 

Simulated 

experimental 

ASVAB 

8/9/10 

Basic  automotive 
mechanic 

MM 

0.65 

0.71 

0.69c 

Basic  electronics 

EL 

0.61 

0.61 

0.65d 

Administrative  clerk 

CL 

0.53 

0.49 

0.58e 

Mean 

0.60 

0.60 

0.64 

^Corrected  for  restriction  of  range. 

“Interim  composites  simulated  as  in  table  22. 
Experimental  Ml  composite  simulated  as  AR+MC+(AI+SI)/2 . 
“Experimental  EL  composite  simulated  as  GS+MK+EI . 
Experimental  CL  composite  simulated  as  VK+MK+NO. 


Our  design  goal  of  improved  differentiation  and  improved  validity 
seems  to  have  been  met  by  the  experimental  composites .  Further  analysis 
will  determine  if  the  complete  set  of  four  is  sufficient  for  all  types 
of  courses . 
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APPENDIX  A 


STUDY  DOCUMENTATION 


This  appendix  contains  the  docunents  received  concerning  this  study 
effort.  The  study  request  Is  presented  first.  The  data  collection  and 
reporting  procedures  are  shown  in  annex  A-l. 


l/N  0107  U  F.TT«  *0tt 

MPI-2  8 :mml 
5400/1 

DATE.!  •/  JAN  jg?7 


TOi  Deputy  Chief  of  Staff  for  Research,  Development  and  Studies 


**•1'  Armed  Services  Vocational  Aptitude  Battery  (ASVAB)  Test 

Validation;  request  for  support  of  Marine  Corps  Operations 
Analysis  Group 

Ref:  (a)  MCO  5400.7B 

1.  In  accordance  with  reference  (a) ,  it  is  requested  that 
a  validation  study  be  conducted  with  the  Armed  Services 
Vocational  Aptitude  Battery  (ASVAB) . 

2.  The  objectives  of  th t  ASVAB  validation  for  service 
school  selection  are: 

a.  Determination  of  best  aptitude  area  composite  for 
predicting  service  schoo.  completion. 

b.  Determination  of  best  combination  of  subtests  for 
prediction  of  service  school  composite. 

c.  Determination  of  the  interrelationship  of  education 
and  aptitude  area  composites  on  service  school  completion. 

d.  Determination  of  service  school  prerequisites  which 
optimize  qualified  personnel  available  and  service  school 
completion. 

3.  Informal  liaison  with  Marine  Corps  Operations  Analysis 
Group  (MCOAG)  representatives  has  been  conducted  concerning 
the  objective  of  the  subject  analysis  and  an  understanding 
of  these  objectives  has  been  reached.  Accordingly,  it  is 
requested  that  the  Deputy  Chief  of  Staff  for  Research, 
Development  and  Studies  task  the  MCOAG  to  conduct  a  validation 
study  of  ASVAB.  Marine  Corps  point  of  contact  is  Mr.  S.  GORMAN, 
GS-11,  Code  MPI-20,  telephone  694-4165. 
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department  of  the  NAVY 

•  Memorandum 

f»om«  Deputy  Chief  of  Staff  for  Manpower 


MCBul  5040 
16  Jan  1978 


INSTRUCTIONS  FOR  COMPLETING  AMD  FORWARDING 
U.  S.  MARINE  CORPS  SCHOOL  DATA  FORM 


1.  The  U.  S.  Marine  Corps  School  Data  Form  will  be  used  to 
evaluate  the  effectiveness  of  the  Armed  Services  Vocational 
Aptitude  Battery  (ASVAB)  in  classifying  Marines  for  basic 
entry  level  training.  The  forms,  which  are  in  optical 
scannable  format,  must  be  completed  for  every  student  entering 
a  course,  whether  he/she  graduates  or  is  dis enrolled  for  any 
reason. 

2.  Forms  should  be  completed  for  all  Marines  who  began 
training  after  1  March  1977  at  any  of  the  courses  listed 
in  enclosure  (1). 

3.  The  following  specific  iirections  should  be  followed  for 
completion  of  the  Marine  Co^ps  School  Data  Form: 

a.  Columns  1-14.  Fill  out  for  all  students. 

(1)  Columns  1-2.  COURSE  NUMBER.  Use  the  appropriate 
course  codes  from  enclosure  Cl). 

(2)  Columns  3-11,  SOCIAL  SECURITY  NUMBER.  Darken 
the  appropriate  columns  witl  social  security  number  or 
military  identification  nunjber  (MID) . 

(3)  Column  12.  PASS/FAIL.  Darken  "1”  if  Marine 
passed  the  course;  darken  "0"  if  Marine  did  not  pass  the 
course. 

(4)  Columns  13-14,  FINAL  COURSE  GRADE.  Darken 
appropriate  columns  with  final  course  grade  in  the  range 
00  through  99.  (Code  final  course  grade  100  as  99.) 

b.  Columns  15-26  are  to  be  filled  out  only  for 
self-paced  courses. 

(1)  FIRST  DAY  OF  CLASS .  Use  the  first  day  of  actual 
self-paced  instruction. 

(a)  Columns  15-16,  DAY.  Darken  the  day  (range 
01  to  31)  of  the  first  day  of  class. 

(b)  Columns  17-13,  MONTH.  Darken  the  month 
thao  the  self-paced  instruction  began  (range  01  to  12). 

(c)  Columns  19-20,  YEAR.  Darken  the  year  of 
instruction  (range  77  to  20) . 
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(2)  LAST  DAY  OF  CLASS.  Use  the  date  that  the  Marine 
last  attended  Instruction. 

(a)  Columns  21-22,  DAY.  Use  the  last  day  of 
actual  instruction  (range  01  to  31) . 

(b)  Columns  23-24,  MONTH.  Darken  the  month 
instruction  ended  (range  01  to  12). 

(c)  Columns  25-26,  YEAR.  Darken  the  year 
instruction  ended  (range  77  to  8 jJT 

4.  Complete  the  forms  using  a  No.  2  lead  pencil  to  darken  the 
appropriate  entry  horizontally  from  dot  to  dot  as  indicated 
in  the  sample  on  page  3  of  this  enclosure. 

3.  After  course  completion,  mail  completed  forms  to  the 
below  address.  Include  forms  for  any  Marines  dise.nrolled 
for  any  reason. 


MCOAG  Study  Director 
ASVAB  Validation  Study 
Center  for  Naval  Analyses 
1401  Wilson  Boulevard 
Arlington,  Virgir._a  22209 

6.  Queries  concerning  completion  of  the  study  may  be 
directed  to  Dr.  William  SIMS,  MCOAG,  Arlington,  Virginia, 
AUTOVON  225-9241,  commercial  (703)  524-9400  or  Major  Harold 
D.  HOCKADAY,  Commandant  of  the  Marine  CorDS  (Code  MPI-20), 
AUTOVON  224-4165,  commercial  (703)  694-4165. 
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APPENDIX  B 


DEFINITIONS  OF  ASVAB  6/7  TESTS  AND  COMPOSITES 


The  individual  ASVAB  6/7  tests  are  given  in  table  B-l.  Composites 
used  by  the  Army  and  Marine  Corps  are  shown  in  table  B-2.  These 
composites  are  defined  by  the  formulas  given  in  table  B-3.  Composites 
used  by  the  Navy  and  Air  Force  are  defined  by  the  formulas  given  in 
table  B-4. 


B-l 
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TABLE  B-i 


INDIVIDUAL  ASVAB  6/7  TESTS 


GI 

■ 

General  Information 

NO 

- 

Numerical  Operations 

AD 

- 

Attention  to  Detail 

WK 

am 

Word  Knowledge 

AR 

m 

Arithmetic  Reasoning 

SP 

ss 

Spacial  Perception 

MK 

K 

Mathematics  Knowledge 

El 

Electronic  Information 

MC 

at 

Mechanical  Comprehension 

GSa 

= 

General  Science 

SI 

as 

Shop  Information 

AI 

3 

Automotive  Information 

CC 

- 

Combat  Scale 

CA 

- 

Attentiveness  Scale 

CE 

- 

Electronics  Scale 

CM 

_ 

Maintenance  Scale 

*Note  that  the  full-length  GS  test,  rather  than  the 
short  GSB  test,  is  used  throughout  this  report. 


TABLE  B-2 


MARINS  CORPS  AND  ARMY  ASVAB  6/7  COMPOSITES 


CO 

m 

Combat 

FA 

m 

Field  Artillery 

OF 

m 

Operators  and  Food  Handlers 

MM 

m 

Mechanical  Maintenance 

GM 

m 

General  Maintenance 

CL 

m 

Clerical 

GT 

m 

General  Technical 

EL 

m 

Electronics 

SC 

m 

Surveillance  and  Communications 

ST 

» 

Skilled  Technical 

GCT 

. 

General  Classification  Test 

B-3 
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TABLE  B-3 


FORMULAS  FOR  COMPUTING  MARINE  CORPS  AND  ARMY 


ASVAB  6/7 

COMPOSITES 

CO 

m 

AR 

+ 

SI 

+ 

SP 

+ 

AD 

+ 

cc 

FA 

m 

AR 

+ 

GI 

+ 

MK 

+ 

El 

+ 

CA 

MM 

m 

MK 

+ 

SI 

+ 

El 

+ 

AI 

+ 

CM 

GMa 

m 

AR 

+ 

GS 

+ 

MC 

+ 

AI 

CL 

m 

AR 

+ 

WK 

+ 

AD 

+ 

CA 

GT 

m 

AR 

+ 

WK 

ELa»b 

m 

AR 

+ 

GS 

+ 

MK 

+ 

El 

ELa*c 

m 

AR 

+ 

El 

+ 

MC 

+ 

SI 

+ 

C£ 

SC 

m 

AR 

+ 

WK 

+ 

MC 

+ 

SP 

STa 

m 

AR 

+ 

MK 

+ 

GS 

OF 

m 

GI 

+ 

A1 

+ 

CA 

GCT 

m 

AR 

+ 

WK 

+ 

SP 

aGS  rather  than  GSB  is  used  throughout  this  report . 
'’Marine  Corps  only . 
cArmy  only . 
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TABLE  B-4 

FORMULAS  FOR  COMPUTING  NAVY  AND  AIR  FORCE 
ASVAB  6/7  COMPOSITES 

Navy 

G  -  WK  +  AR 

M  -  WK  +  MC  +  SI 

E  •  AR+MK+EI+GS 
C  -  NO  +  AD  +  WK 

Air  Force 

M  -  MC  +  SI  +  AI 

A  -  NO  +  AD  +  WK 

G  *  WK  +  AR 

E  -  AR  +  SP  +  El 
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APPENDIX  C 

ONCORKECTED  CORRELATION  COEFFICIENTS 


APPENDIX  C 


UNCORRECTED  CORRELATION  COEFFICIENTS 


Uncorrected  validity  coefficients  for  individual  ASVAB  tests  and 
composites  are  shown  in  tables  C-l  and  C-2,  respectively.  Uncorrected 
means  and  standard  deviations  of  the  criterion  variable  (FCG)  are  shown 
in  table  C-3. 
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TABLE  C-3 


UNCORRECTED  MEANS  AND  STANDARD  DEVIATIONS  OF  FCG  VARIABLE 


Course 

Mean 

Standard 

deviation 

Basic  supply  stock  clerk 

82.4 

7.7 

Personal  financial  records  clerk 

83.9 

7.2 

Basic  automotive  mechanic 

84.4 

6.3 

Advanced  automotive  mechanic 

82.8 

6.9 

Basic  baker 

88 .4 

4.2 

Basic  food  service 

84 .0 

5.2 

Basic  combat  engineer 

83 .0 

6.8 

Basic  electrician 

89.0 

5.5 

Electrical  equipment  repairman 

82.9 

6.1 

Basic  engineer  equipment  mechanic 

86.3 

5.6 

Administrative  clerk 

83.5 

7.2 

Personnel  clerk 

89.8 

5.2 

Unit  diary  clerk 

83.7 

7.3 

Sea  duty  Indoctrination 

81.9 

5.9 

Basic  electronics 

80.7 

8.7 

Radio  fundamentals 

81.8 

6.2 

Field  radio  operator 

87.1 

5.2 

Communications  center  man 

82.7 

7.5 

Air  control  electronic  operator 

81.0 

5.6 

Infantry  training 

83.8 

7.6 

Tracked  vehicle  repair 

85.3 

5.0 

Basic  helicopter 

79.9 

6.9 

Aviation  structural  mechanic  (safety  equipment) 

77.4 

5.7 

Aviation  structural  mechanic  (hydraulics) 

78.5 

7.5 

Aviation  structural  mechanic  (structures) 

77.2 

5.9 

Aviation  ordnance 

82.2 

5.3 

Aviation  crash  crew 

84.2 

5.3 

Avionics  repair 

76.6 

4.6 

Air  controlman 

86.6 

3.2 

Aircraft  launch  &  recovery 

78.9 

6.0 

Aviation  operations  (clerical) 

87.0 

5.8 

Aviation  maintenance  administration 

77.8 

7.9 

Aviation  supply  (mechanical) 

82.0 

8.1 

Aerographers  mate 

85.8 

6.4 

Small  arms  repair 

88.6 

5.4 

Field  artillery  fire  control 

88 .4 

6.1 

Ammunition  storage 

86  .0 

4.7 

Basic  cannoneer 

89.5 

4.4 

APPENDIX  D 


CORRECTION  FOR  RESTRICTION  OF  RANGE 


In  this  appendix  we  discuss  distortions  of  correlation  coefficients 
by  range  restriction  and  examine  two  methods  used  to  correct  data  for 
this  distortion. 

Figure  D-l  illustrates  range  restriction.  It  shows  the  envelope  of 
a  typical  scattergram  that  would  result  if  a  success  criterion  such  as 
final  course  grade  (y)  were  plotted  against  an  ASVAB  score  (x)  used 
to  select  recruits  for  a  particular  training  course.  Recruits  with 
ASVAB  scores  below  the  minimum  allowed  for  the  course  never  attend  the 
course.  Data  from  these  recruits  (shaded  area)  will  be  missing  from  the 
sample.  The  sample  is  then  said  to  be  restricted.  This  restriction 
tends  to  reduce  the  size  of  the  correlation  measured  between  variables 
x  and  y  . 


FIG.  D-1:  ILLUSTRATION  OF  RANGE  RESTRICTION 


D-l 


SINGLE  VARIABLE  CORRECTION 


One  method  of  correcting  for  range  restriction  may  be  referred  to 
as  the  single-variable  method.  With  this  method  the  corrected  corre¬ 
lation  between  variables  x  and  y  is  given  in  [D-l]  as 


and 


R 

xy 


~r 


(D-l) 


where: 

r  *  the  correlation  between  x  and  y  in  the  restricted  sample 

sx  »  the  standard  derivation  of  x  in  the  restricted  sample 
Sy  =  the  standard  deviation  of  y  in  the  restricted  sample. 

Rxy»  sx»  and  sy  are  c°rr®sponding  variables  in  the  unrestricted 
sample.  The  values  of  r  ,  sx,  sx,  and  Sy  will  be  known  and,  hence, 
values  of  Rxy  and  Sy  may  De  calculated  using  equations  D-l  and  D-2. 

MULTIVARIABLE  CORRECTION 

In  the  multivariable  case  restrictions  are  assumed  to  have  been 
made  on  more  than  one  test  score.  The  multivariable  case  is  more 
realistic  in  our  situation  because  selection  for  courses  (and,  hence, 
restriction)  takes  place  directly  or  indirectly  on  all*  ASVAB  scores. 

We  use  a  multivariable  range  correction  program  developed  by  {D-2] 
using  the  matrix  algebra  methodology  of  Burt  [D— 3 ] .  In  this  method  the 
intercorrelations  of  all  ASVAB  scores  in  the  unrestricted  population  are 


*  For  example,  recruits  selected  for  course  "A”  with  a  GT  prerequisite 
will  be  directly  selected  on  GT.  However,  because  the  sample  may  have 
already  been  depleted  of  those  recruits  scoring  high  in  other  aptitudes 
(for  assignment  to  other  courses)  the  recruits  in  course  "A”  will  have 
also  been  indirectly  restricted  on  other  tests  in  the  ASVAB. 


input  as  the  "base  matrix.”*  The  restricted  sample  is  represented  by 
the  intercorrelation  matrix  of  all  ASVAB  scores  (and  final  course  grade) 
formed  from  the  recruits  in  each  training  school .  From  these  two 
matrixes  (and  variable  means  and  standard  deviations  in  both  the 
restricted  and  unrestricted  samples)  a  corrected  correlation  matrix  is 
calculated .  Complete  matrix  input  and  output  are  shown  for  one  sample 
course  (Basic  Electronics)  in  annex  D-l . 

VALIDITY  OF  THE  METHOD 

We  experimentally  examined  the  validity  of  the  two  correction 
methods.  For  our  experiment  we  selected  recruits  from  the  Adminis¬ 
trative  Clerk  Course  as  an  "experimental  base  population.”  We  then 
simulated  a  restriction  in  this  sample  by  removing  all  recruits  who 
scored  in  the  lower  third  on  the  ASVAB  selector  composite  for  that 
course  (CL).  We  then  corrected  this  restricted  sample  using  both  the 
single  and  multivariable  procedures  .  Finally,  we  compared  the  resulting 
corrected  correlations  with  those  actually  observed  in  our  experimental 
base  population.  In  table  D-l  we  tabulate  the  validities  observed  in 
our  experimental  base  population,  the  simulated  restricted  sample,  and 
as  corrected  by  the  single  and  multivariable  procedure .  We  also  tabu¬ 
late  the  error  introduced  by  the  simulated  restriction  and  the  error 
remaining  after  applying  the  single  and  multivariable  correction 
procedure  . 

We  see  from  table  D-l  that  the  simulated  restriction  does  distort 
the  observed  validity  coefficients.  We  also  see  that  neither  the  single 
or  multivariable  correction  procedure  removes  all  of  the  distortion. 
Similar  results  were  found  by  a  simulated  restriction  on  the  Basic 
Automotive  Mechanics  Course  followed  by  correction.  These  results  are 
tabulated  in  table  D-2 .  The  results  from  tables  D-l  and  D-2  are 
summarized  in  table  D-3 .  Table  D-3  shows  the  mean  of  tlv  ^solute  -value 
of  the  errors  found  in  our  experiment .  For  example  we  ■  f-o  in  the 
Administrative  Clerk  Course  that  a  mean  error  of  0.06  in  test  score 
validities  was  induced  by  the  simulated  restriction.  We  also  see  that 
the  single  variable  and  the  multivariable  correction  procedures  reduced 
this  mean  error  to  0.05  and  0.03,  respectively.  The  results  shown  in 
table  D-3  indicate  that  the  multivariable  correction  procedure  is 
preferable  to  either  no  correction  or  to  the  single  variable 
procedure.  However,  it  is  clear  that  even  the  multivariable  procedure 
leaves  a  significant  residual  error.  Table  D-3  indicates  that  neither 
correction  procedure  is  useful  for  dichotomous  variables .  Further 
reference  to  tables  D-l  and  D-2  shows  that  the  range  of  residual  error 


*  A  23,106-case  random  sample  of  Marine  Corps  recruits  entering  recruit 
training  during  calendar  year  1977  was  selected  to  produce  the  base 
matrix.  This  is  an  appropriate  population  because  it  is  the  one  from 
which  recruits  are  selected  for  training  on  the  basis  of  ASVAB  scores. 


EFFECT  OF  TWO  CORRECTION  PROCEDURES  ON  VALIDITY  COEFFICIENTS  FOR  ADMINISTRATIVE  CLERKS  COURSE 
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in  the  validities  of  tests  and  composites  (after  multivariable 
correction)  varies  from  0.00  to  0.11. 


CORRECTION  PROCEDURE  USED  IN  THIS  ANALYSIS 

We  use  the  multivariable  correction  procedure  in  this  analysis. 
However,  we  note  that  it  does  not  correct  all  distortion  induced  by 
range  restriction.  We  estimate  the  residual  uncorrected  distortion  in 
validity  coefficients  to  range  from  0.00  to  0.11. 
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ANNEX  D-l 


SAMPLE  RANGE  CORRECTION  PROGRAM  INPUT  AND  OUTPUT 


The  means  and  standard  deviation  of  the  tests  and  composites  of  the 
base  population  are  shown  in  table  D-l-1.  The  variable  definitions  are 
as  given  in  appendix  B;  except  that  the  prefix  "ARMY"  Indicates  an  Army- 
only  composite,  “AIR”  indicates  an  Air  Force  composite,  and  "NAV" 
indicates  a  Navy  composite.  The  correlation  coefficients  between  the 
various  test  scores  in  the  base  population  are  shown  in  table  D-l-2. 
Similar  tables  of  uncorrected  data  from  one  course  (Basic  Electronics) 
are  shown  in  tables  D-l-3  and  D-l-4.  Tables  D-l— 1,  D-l-2,  D-l-3,  and 
D-l-4  are  input  to  the  correction  program*  Sample  output  tables  of 
corrected  data  (Basic  Electronics)  are  shown  in  tables  D-l-5  and  D-l-6. 
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APPENDIX  E 


STATISTICAL  UNCERTAINTY  OF  CORRELATION  COEFFICIENTS 


Estimates  of  the  statistical  uncertainty  In  correlation  coeffi¬ 
cients  as  a  function  of  sample  size  and  magnitude  of  the  correlation 
coefficient  are  taken  from  [E-l]  and  shown  in  figure  E-l. 

Families  of  curves,  one  for  each  range  of  correlation  coefficients 
are  shown  in  figure  E-l.  Each  curve  shows  the  statistical  uncertainty 
in  the  correlation  coefficient  as  a  function  of  sample  size.  For 
example,  the  lower  curve  (appropriate  for  use  with  correlation  coeffi¬ 
cients  of  approximately  0.9)  indicates  that  we  should  expect  a  statist! 
cal  error  of  0.03  in  a  0.90  correlation  coefficient  obtained  from  a 
sample  of  40  cases. 


AND  STATISTICAL  UNCERTAINTY 
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[E_l]  CNA,  Study  1084,  "An  Analysis  of  Marine  Corps  School  Assignment 
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EFFECT  OF  EDUCATION,  RACE,  AND 
SEX  ON  COURSE  PERFORMANCE 


To  determine  if  educational  level,  race,  or  sex  had  any  effect  on 
course  performance  (after  controlling  for  ASVAB  scores)  the  following 
regression  equation*  was  estimated  for  each  course: 

FCG  -  A  +  B  (ASVAB)  +  C  (EDUC)  +  D  (RACE)  +  E  (SEX)  (F-l) 

where: 

ASVAB  =  ASVAB  composite  score  recommended  for  this  course 
EDUC  *  1  for  high  school  graduates,  0  otherwise 
RACE  =■  1  for  whites,  0  otherwise 
SEX  »  1  for  males,  0  otherwise 
A,B,C,D,E  *  constants  to  be  estimated 
FOG  ■  final  course  grade. 

For  those  dichotomous  variables  found  to  be  significant  the  size  of  the 
effect  was  expressed  as  the  number  of  composite  score  points  that  were 
equivalent  to  the  effect. 

RESULTS  OF  REGRESSION  ANALYSIS 

Results  are  shown  in  table  F-l.  For  example,  in  the  Administrative 
Clerk's  Course,  the  final  course  grade  of  a  high  school  graduate  will  be 
the  same  as  that  of  a  nongraduate  with  a  CL  score  19.0  points 
higher.**  The  grade  of  a  Caucasian  will  be  the  same  as  that  of  a  non- 
Caucasian  with  a  CL  score  about  11.9  points  higher  and  a  male's  grade 
will  be  equal  to  that  of  a  female's,  with  a  composite  score  8.0  points 
lower. 


The  data  of  table  F-l  are  summarized  in  table  F-2.  To  minimize 
misinterpretations  due  to  small  sample  size  only  results  from  courses 
containing  at  least  100  cases  for  each  value  of  each  dichotomous 


*  The  regression  analysis  was  conducted  on  data  uncorrected  for  range 
restriction.  This  procedure  was  possible  because  only  one  ASVAB  score 
was  being  used  in  each  regression.  The  procedure  was  desirable  because, 
as  noted  in  appendix  D,  range  correction  is  very  unreliable  for 
dichotomous  variables  such  as  those  in  equation  F-l. 

**  For  example,  the  regression  equation  for  this  course  is: 

FCG  -  57.7  +  0. 19(ASVAB)  +  3.61(EDUC)  +  2.27(RACE)  -  1.52(SEX). 

Therefore  the  number  of  ASVAB  composite  points  that  would  be  equivalent 

to  the  effect  of  the  EDUC  variable  is  *  19.0  . 

0.19 


F-l 
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EFFECT  OF  EDUCATION,  RACE,  AND  SEX  ON  PERFORMANCE  IN  MILITARY  COURSES 
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variable  (education,  race,  and  sex)  were  summarized.  The  results  In 
table  F-2  Indicate  that  the  effect  of  educational  level  on  validity  Is 
consistent  across  a  wide  spectrum  of  courses.  On  average,  high  school 
graduates  perform  in  training  like  non-high  school  graduates  with  com¬ 
posite  scores  about  13  points  higher.  Because  of  the  size  and 
consistency  of  the  effect  we  recommend  compensating  actions  be  taken. 

With  respect  to  race,  the  situation  is  less  clear.  In  8  of  the  15 
courses  examined,  the  minority  recruits  did  not  perform  as  well  in 
training  as  other  recruits  with  the  same  composite  scores.  However,  the 
effect  is  small  and  is  not  consistent  across  all  courses.  On  average, 
the  ASVAB  overpredicts  minority  performance  by  about  6  composite 
points.  In  any  event,  the  data  are  conclusive  that  the  ASVAB  is  not 
biased  against  minorities.  If  any  bias  exists,  it  appears  to  be  in 
favor  of  minorities.  Because  the  effect  is  small  and  not  consistent 
over  all  courses  we  recommend  that  no  compensating  actions  be  taken. 


TABLE  F-2 

SUMMARY  OF  EFFECT  OF  CIVILIAN  EDUCATION,  RACE,  AND  SEX 
ON  COURSE  PERFORMANCE 


Number  of 
courses 
in  which 

Number  of  variable  was. 


Variable  courses 


Mean  equivalent 
composite  scgre 
points  * 


Group 
for  which 
performance  is 


significant  underprediction  underpredicted 


Education 


Graduates 


Whites 


Females 


^Courses  in  which  each  dichotomous  subgroup  contained  100  or  more  cases. 
“Significant  at  the  99  percent  confidence  level. 

cNumber  of  composite  score  points  to  which  membership  in  the  better 
performing  dichotomy  is  equivalent. 

aIn  computing  the  mean,  courses  for  which  the  variable  were  not  sta¬ 
tistically  significant  were  assigned  zero  equivalent  score  points. 


With  regard  to  females,  the  availability  of  sufficient  cases 
precluded  general  conclusions.  There  were  only  two  courses  with  10 0  or 
more  females.  In  one  of  these  courses  sex  did  seem  to  make  a  difference 
in  predicting  training  performance.  Here,  as  is  the  case  for  race,  the 
effect  is  small  and  not  consistent  for  all  courses.  On  average,  the 
ASVAB  seems  to  underpredlct  the  performance  of  females  by  about  4 


composite  score  points.  Due  to  the  small  size  and  lack  of  consistency 
of  the  effect,  we  recommend  that  no  compensating  actions  be  taken. 

RAW  DATA  DISTRIBUTIONS 


To  rule  out  the  possibility  that  the  effects  of  education,  race, 
and  sex  on  performance  are  induced  by  the  regression  procedure  we 
examined  raw  data  distributions.  The  Administrative  Clerk  and  Basic 
Auto  Mechanics  courses  were  selected  for  this  examination  because  of 
their  representative  nature  and  large  sample  size.  Mean  final  course 
grade  was  tabulated  for  ASVAB  composite  scores  in  10-point  intervals  (CL 
for  Administrative  Clerk  and  GM  for  Basic  Auto  Mechanics).  The  data 
were  then  further  broken  out  by  educational,  racial,  and  sex  groups  in 
table  F-3,  F-4,  and  F-5.  These  tables  show  the  same  types  of 
differences  that  emerged  from  the  regression  analyses.  Therefore,  we 
conclude  that  the  results  of  the  regression  analysis  with  respect  to 
differential  prediction  of  population  subgroups  represent  real  ef feces 
and  are  not  induced  by  the  regression  procedure. 


TABLE  F-3 

MEAN  FINAL  COURSE  GRADE  BY  APTITUDE 
SCORE  INTERVAL  BY  EDUCATION 


Mean  final  course  grade 


Course 

Aptitude 
score  interval 

High  school 
graduate 

Non-high  school 
graduate 

90-99 

78.8 

_a 

Administrative 

100-109 

81.3 

77.7 

clerk 

110-119 

83.2 

79.4 

120-129 

85.9 

81.2 

90-99 

81.3 

78.9 

Basic  auto  mechanic 

100-109 

84.2 

82.1 

110-119 

87.2 

85.6 

120-129 

89.6 

87.0 

*”0)18  Interval  contains  too  few  recruits  to  reflect  statistically  sound 
results. 


F-4 


TABLE  P-4 


MEAN  FINAL  COURSE  GRACE  BY  APTITUDE 
SCORE  INTERVAL  BY  RACE 


Mean  final  course  grade 


Course 

Aptitude 
score  interval 

Caucasian 

Non-caucasian 

90-99 

80.6 

76.9 

Administrative 

100-109 

81.4 

79  .6 

clerk 

110-119 

83.0 

80  .9 

120-129 

85.3 

83.1 

90-99 

81 .2 

79.8 

Basic  auto  mechanic 

100-109 

83.6 

83.1 

110-119 

87  .0 

85.5 

120-129 

89.1 

-a 

aThls  Interval  contains  too  few  recruits  to  reflect  statistically  sound 
results . 


TABLE  F-5 

MEAN  FINAL  COURSE  GRADE  BY  APTITUDE 
SCORE  INTERVAL  BY  SEX 


Mean  final  course  grade 


Course3 

Aptitude 
score  interval 

Female 
high  school 
graduate 

Male 

high  school 
graduate 

Administrative 

90-99 

_b 

78.7 

clerk 

100-109 

83.6 

80.1 

110-119 

84.7 

82  .4 

120-129 

86.2 

85.6 

aThere  were  too  few  females  in  the  Basic  Auto  Mechanics  Course  to  allow 
the  display  of  data . 

^This  interval  contains  too  few  recruits  to  reflect  statistically  sound 
results . 
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APPENDIX  G 


PERFORMANCE  AS  A  FUNCTION  OF 
APTITUDE  COMPOSITE  SCORE 


In  this  appendix  we  tabulate  CY  1977-78  performance  data  by 
aptitude  composite  interval  for  the  46  courses  for  which  such  informa¬ 
tion  was  available.  We  also  tabulate  FY  1980  course  failure  rates  for 
86  courses. 

Table  G-l  shows  mean  final  course  grade  by  aptitude  composite 
interval.*  The  aptitude  composites  used  are  those  that  were  found  to  be 
most  appropriate  for  each  course.  All  composite  scores  are  expressed  in 
terms  of  correct  ASVAB  6/7  norms. 

Table  G-2  shows  the  percentage  of  recruits  in  each  composite  score 
interval*  that  fail  the  indicated  course.  Table  G-3  shows  the  failure 
rate  expected  for  the  class  as  a  whole  if  only  recruits  at  or  above  the 
indicated  cut  score  were  allowed  to  enter  the  course. 

Table  G-4  shows  the  FY  1980  course  failure  rates  for  86  courses. 


*  No  entries  are  shown  in  tables  G-l  or  G-2  for  composite  intervals 
containing  less  than  20  individuals  because  the  data  were  judged  to  be 
statistically  unreliable. 
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TABLE  G-2  (ContM) 


CUMULATIVE  PERCENTAGE  OF  FAILURES  FOR  INDICATED  CUT  SCORE 
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G-6 


Aviation  supply  (mechanical) 


TABLE  G-3  (Cont'd) 


TABLE  G-4 


FY  1980  COURSE  FAILURE  RATES 

Failure  rate 


_ Course  title _  (percent) 

Air  traffic  controller  30.0 

Advanced  auto  mechanic  14 .5 

Air  control  electronics  operator  27 .6 

Machinists  mate  8.0 

Aerographers  mate  20  .4 

Aviation  structural  mechanics 

safety  equipment  5 .0 

hydraulics  6.0 

structures  8.0 

Aviation  ordnance  12.0 

Airborne  radio  operator  24.0 

Aviation  support  equinment,  electrical  4.0 

Aviation  support  equipment,  mechanical  6.0 

Air  support  electronics  operator  20.0 

Aviation  crash  crew  3  .0 

Aviation  maintenance  administration  — 

Basic  electricity  and  electronics  18 .0 

Basic  helicopter  maintenance  4 .0 

Cryogenic  equipment  technician  15 .0 

HAWK  missile  fire  control  crewman  5.6 

HAWK  launcher  and  mechanical  systems  repair 
Aircraft  launch  and  recovery  equipment  1.0 

Marine  aviation  supply,  mechanized 
Aviation  operations  clerk 

Missile  system  maintenance  fundamentals  6.7 

Aerial  navigator  35 .0 

Aircrew  survival  equipment  4  .3 

Turboprop  mechanic  8 .9 

REDEYE  gunner  6.1 

Ammunition  storage  3.7 

Assault  amphibian  crewman  — 

Artillery  ballistic  meteorology  5.3 

Marine  artillery  scout  observer  22.0 

Aviation  support  equipment  technician  (Elec)  4.0 

Audio/TV  production  specialist  16.7 

Basic  automotive  mechanic  13.2 

Artillery  repair  1 .9 

Administrative  clerk  3.5 

Basic  baker  4.9 

Basic  packing  and  preservation  man 

Personal  financial  records  clerk  3.1 

Basic  electronics  24.9 

Basic  electricity  and  electronics  18.0 
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TABLE  G-4  (Cont’d) 


Course  title 

Failure  rate 
(percent) 

Metal  body  repair 

14 .0 

Basic  travel  clerk 

4.7 

Fabric  repairman 

11.6 

Basic  cartography 

25.8 

Basic  combat  engineer 

2.6 

IBM  system  360  OS,  COBOL 

3.9 

Construction  drafting 

8.3 

Communications  center  man 

8.8 

Construction  surveying 

11.8 

Corrections  specialist 

4.2 

Cryptographic  technician,  0 

15.3 

Cryptographic  technician,  R 

28.0 

Cryptographic  technician,  T 

47.4 

Defense  language  institute 

— 

Basic  engineer  equipment  mechanic 

4.7 

Engineering  equipment  operator 

1.1 

Electrical  equipment  repairman 

7.1 

Basic  electrician 

2.7 

Basic  amphibious  embarkation  man 

21.0 

Financial  accounting  clerk 

11.8 

Field  artillery  radar  crewman 

3.0 

Field  artillery  fire  control 

25.0 

Fire  control  instrument  repair 

10.4 

Basic  food  service  man 

10.5 

Basic  lithographic  processes 

— 

Field  radio  operator 

8.8 

Geodetic  surveying 

24.2 

Graphics  specialist 

11.1 

HAWC  launcher  and  mechanical  systems  repair 

— 

Intelligence  specialist 

5.0 

Information  specialist  (broadcaster) 

36.9 

Information  specialist  (journalist) 

21.4 

Small  arms  repair 

3.0 

Laundry  and  bath  specialist 

1.0 

Legal  services  man 

3.7 

Marine  barracks 

— 

Basic  metal  worker 

19.9 

Military  police 

16.9 

Offset  duplicating 

9.8 

Offset  printing 

30 .0 

Office  machine  repair 

4.2 

IBM  systems  360,  OS,  operations 

4.0 

Continuous  photoprocessing  specialist 

21.4 

Basic  plumbing  and  water  supply  man 

3.5 

TABLE  G-4  (Cont’d) 


Course  title 


Failure  rate 
(percent) 


Postal  operations  9.3 
Quartermaster  equipment  repair  7 .2 
Basic  refrigeration  mechanic  2.0 
Machinist  37 .9 
Sea  duty  21 .1 
Shore  fire  control  party  2.5 
Still  photographic  specialist  10.5 
Subsistence  supply  man  11 .4 
Basic  supply  stock  control  man  10.4 
Tank  crewman  5 .8 
Assault  amphibian  repairman  15 .4 
Tracked  vehicle  repair,  artillery 

Tracked  vehicle  repair,  tank  1 .6 
Infantry  training  5 .2 
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APPENDIX  H 


FACTOR  ANALYSIS 


The  factor  analysis  reported  here  was  done  using  the  standard 
routines  in  the  SPSS*  software  package  [H-l]  The  data  were  obtained 
from  a  random  sample  of  23,061  Marine  Corps  recruits  tested  on  ASVAB  6/7 
at  recruit  depots  in  1977 . 

Each  variable  is  assumed  to  be  made  up  of  a  unique  part  plus  Bhared 
common  factors .  The  assumptions  may  be  expressed  as 

xj  “  ajlFl  +  aj2F2  *  +  ajmFm  +  djUj  » 

where : 

n  «  number  of  original  variables 

j  *1,2,  ..Vn 

Xj  *  variable  j  in  standardized  form 
“  the  mLfc  common  factor 

Uj  *  unique  factor  for  variable  j 

ajj  *  standardized  multiple  regression 

coefficient  of  variable  j  on  factor  i  (also  called  the 
factor  loading} 

dj  »  standardized  regression  coefficient  of  variable  j  on 
unique  factor  j 

The  specific  method  used  is  referred  to  as  "principal  factoring 
with  iterations."  The  steps  involved  are  summarized  as  follows: 

1.  Carry  out  principal  factoring  using  unaltered  (unity  on  diag¬ 
onals)  correlation  matrixes  in  table  H-l  as  input .  As  many 
factors  are  identified  as  there  are  variables  in  the  data  set. 

2.  The  number  of  factors  to  be  extracted  is  taken  as  the  number  of 
factors  in  step  1  that  have  eigenvalues  equal  to  or  greater  than 
1.0.  This  criterion  ensures  that  only  factors  accounting  for  at 
least  the  amount  of  variance  of  a  single  variable  will  be 
treated  as  significant. 

3.  The  main  diagonals  in  the  correlation  matrixes  are  replaced  by 
squared  multiple  correlations  (SMC)  as  initial  estimates  of  the 
communality  of  the  relevant  variable  with  all  other  variables  in 
the  set . 

4 .  The  number  of  factors  determined  in  step  2  are  extracted  . 


*  Statistical  Package  for  the  Social  Sciences. 
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5.  The  variances  accounted  for  by  these  factors  become  new  com¬ 
munal  ity  estimates. 

6.  Diagonal  elements  of  the  correlation  matrix  are  replaced  by  the 
new  communality  estimates  from  step  5,  and  the  process  is  re¬ 
peated  until  the  differences  between  successive  estimates  of  the 
communality  become  negligible. 

7.  After  the  iterative  process  in  step  6  is  terminated,  the  se¬ 
lected  factors  are  rotated  orthogonally  (Varimax  rotation)*  to 
produce  a  simple  representation  of  the  factors.  The  resulting 
factor  loadings  are  given  in  table  H-2. 

The  factor  loadings  in  table  H-2  could  be  used  to  express  the  input 
variables  in  terms  of  the  extracted  factors.  The  factor  score  co¬ 
efficients  for  the  individual  ASVAB  tests  are  shown  in  table  H-3.  These 
coefficients  could  be  used  to  estimate  the  factors  in  terms  of  the 
variables. 

An  examination  of  table  H-3  discloses  that  factor  1  draws  heavily 
on  the  SI,  AT,  and  CM  tests.  These  are  all  shop-oriented  tests;  hence, 
we  identify  factor  1  as  the  "shop"  factor.  Factor  2  is  seen  to  have 
large  factor  score  coefficients  for  the  mathematically  oriented  NO,  AR, 
and  MK  tests.  Hence,  we  call  factor  2  the  "math”  factor.  Factor  3  is 
seen  to  have  large  positive  coefficients  for  the  WK  and  GS  tests;  hence, 
we  identify  this  factor  as  the  "verbal"  factor.  Factor  4  has  large 
coefficients  for  CA  and  CR.  These  two  tests  are  interest  inventories 
and  attempt  to  measure  attentiveness  and  electronics  interest,  respec¬ 
tively.  We  somewhat  arbitrarily  call  this  factor  an  "attltudinal" 
factor. 

The  variance  in  scores  on  each  test  that  may  be  attributed  to  each 
factor  is  given  by  the  square  of  the  rotated  factor  loading  shown  in 
table  H-2.  Variance  attributed  to  the  common  factors  (communality),  the 
unique  factors  (specificity),  and  error  are  calculated  as  shown  in 
table  H-4. 


*  Oblique  rotations  were  also  tried  and  similar  results  were  obtained 


TABLE  H-2 


ROTATED  FACTOR  LOADINGS* ,b 


Test 

FOR  INDIVIDUAL  ASVAB 

Factor 

TESTS 

Factor  1 

Factor  2 

Factor  3 

Factor  4 

GI 

0.28868 

0.12946 

0.62523 

-0.00793 

NO 

0.05064 

0.63935 

0.23364 

0.13060 

AD 

0.01309 

0.45882 

0.00133 

0 . 08465 

WK 

0.06680 

0.15161 

0.77660 

0.12101 

AR 

0.17924 

0.53673 

0.51989 

0.13351 

SP 

0.30669 

0.29308 

0.28622 

0.02412 

MK 

0.09940 

0.59009 

0.51460 

0. 18016 

El 

0.48970 

0.17931 

0.57682 

0.07245 

MC 

0.49852 

0.30401 

0.53012 

-0.00724 

GS 

0.23393 

0.19511 

0.75372 

0.11221 

SI 

0.65588 

0.11588 

0.44458 

-0.11572 

AI 

0.68441 

0.04271 

0.41086 

-0.07865 

CM 

0.74933 

-0.07464 

-0.09317 

0.32880 

CA 

-0.06628 

0.14771 

0.09564 

0.57031 

CE 

0.23725 

0.15436 

0.05837 

0.72176 

CC 

0.36224 

0.11147 

0.28775 

0.13518 

*Four  factors  were  found.  They  had  initial  unrotated  eigenvalues  of 
6.03,  1.78,  1.48,  and  1.03,  respectively,  and  account  for  64.5  percent 
of  the  total  observed  variance. 

**This  matrix  is  also  referred  to  as  the  "factor  matrix." 


TABLE  H-3 


FACTOR  SCORE  COEFFICIENTS 


Test 

FOR  INDIVIDUAL  ASVAB 

Factor 

TESTS 

Factor  1 

Factor  2 

Factor  3 

Factor  4 

GI 

0  .00760 

-0  .08003 

0 .16272 

-0 .02306 

NO 

-0 .01603 

0.36379 

-0 .09310 

-0  .00592 

AD 

0.01051 

0.20759 

-0  .08566 

-0  .00968 

UK 

-0.17502 

-0  .17394 

0 .37351 

0.11218 

AR 

-0 .02724 

0.25118 

0 .04486 

0.00151 

SP 

0 .04808 

0 .07998 

-0 .01693 

-0  .03193 

MK 

-0.07521 

0 .33357 

0.05187 

0.03570 

El 

0.10197 

-0 .03241 

0.11213 

-0 .00384 

MC 

0.15851 

0.11925 

0.03914 

-0.11014 

GS 

-0  .08211 

-0 .13201 

0.31790 

0 .07319 

SI 

0.26534 

-0 .00060 

0.02973 

-0 .’  7959 

AI 

0.25113 

-0  .07834 

0.04121 

-0.13711 

CM 

0.44674 

-0 .07889 

-0.23127 

0.24326 

CA 

-0  .06600 

-0  .00559 

0.01916 

0.27503 

CE 

0.02671 

-0  .02830 

-0  .04385 

0 .52968 

cc 

0 .04169 

0  .00046 

0.01789 

0 .02657 
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FACTOR  ANALYSIS  OF  ASVAB  INDIVIDUAL  TESTS 
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